Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5149 originally caused by: Started by upstream project "master-osmo-pcu" build number 5351 originally caused by: Started by upstream project "master-libosmo-gprs" build number 132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3906 originally caused by: Started by upstream project "master-osmo-pcu" build number 5351 originally caused by: Started by upstream project "master-libosmo-gprs" build number 132 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17650 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8942 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29256 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5149 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30031 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9237 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5188 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3906 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins1264929897389286152.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 06:55:01 + trial_dir_prefix=trial- + rm -rf trial-2355 trial-2355-bin.tgz trial-2355-run.tgz + trial_dir=trial-2356 + mkdir -p trial-2356 + mv open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2944.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29256.tgz osmo-nitb.build-12964.tgz osmo-pcu-oc2g.build-3906.tgz osmo-pcu-sysmo.build-5188.tgz osmo-pcu.build-5149.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2356 + cat open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2944.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29256.md5 osmo-nitb.build-12964.md5 osmo-pcu-oc2g.build-3906.md5 osmo-pcu-sysmo.build-5188.md5 osmo-pcu.build-5149.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2944.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29256.md5 osmo-nitb.build-12964.md5 osmo-pcu-oc2g.build-3906.md5 osmo-pcu-sysmo.build-5188.md5 osmo-pcu.build-5149.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2356 combinations: None trial: 'trial-2356' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2356 -------------------------------------------------------------------------------------------- 06:55:12.974721 tst trial-2356: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/log --------------------------------------------------------------------- trial-2356 nitb_sms:sysmo --------------------------------------------------------------------- 06:57:23.859467 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:23.863383 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 06:57:23.885697 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 06:57:23.893178 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 06:57:23.948048 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 06:57:23.969776 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 06:57:23.977171 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 06:57:24.514926 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 06:57:24.520738 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 06:57:24.532208 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 06:57:24.909734 tst mo_mt_sms.py: using LAC 19720 06:57:25.144123 tst mo_mt_sms.py: using RAC 85 06:57:25.269412 tst mo_mt_sms.py: using CellId 19720 06:57:25.393684 tst mo_mt_sms.py: using BVCI 19721 06:57:25.508629 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 06:57:25.691585 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 06:57:25.813655 tst mo_mt_sms.py:9: start nitb and bts... 06:57:26.031309 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:57:28.377382 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4669): Launched 06:57:28.703877 run osmo-nitb_10.42.42.2(pid=4670): Launched 06:57:28.882242 run osmo-nitb_10.42.42.2(pid=4670): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4670)] 06:57:29.015172 run osmo-nitb_10.42.42.2(pid=4670): stdout: | (launched: 2022-12-09_06:57:28.643191) 06:57:29.150244 run osmo-nitb_10.42.42.2(pid=4670): stderr: | (launched: 2022-12-09_06:57:28.691769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:57:29.285088 run osmo-nitb_10.42.42.2(pid=4670): stdout: | (launched: 2022-12-09_06:57:28.643191) 06:57:29.413711 run osmo-nitb_10.42.42.2(pid=4670): stderr: | (launched: 2022-12-09_06:57:28.691769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:57:29.567498 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4670): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4670) [trial-2356↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4670)] [trial-2356↪nitb_sms:sysmo↪mo_mt_sms.py:11] 06:57:29.576445 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 06:57:29.583565 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4669): Terminating (SIGTERM) 06:57:29.794837 --- ParallelTerminationStrategy: PID 4669 died... 06:57:29.816509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4669): Terminated: ok {rc=0} 06:57:29.905515 bus /sierra_3: Setting Powered False 06:57:31.016108 bus /sierra_3: Setting Powered False 06:57:32.152337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:sysmo --------------------------------------------------------------------- 06:57:33.338392 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:33.342245 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 06:57:33.363222 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 06:57:33.390370 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 06:57:33.444398 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 06:57:33.465335 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 06:57:33.491870 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 06:57:34.038946 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:sysmo mo_mt_sms.py ---------------------------------------------- 06:57:34.043868 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:57:34.054609 tst sms:sysmo: Using 1 x bts (candidates: 1) 06:57:34.087906 tst mo_mt_sms.py: using LAC 19721 06:57:34.219458 tst mo_mt_sms.py: using RAC 86 06:57:34.348736 tst mo_mt_sms.py: using CellId 19721 06:57:34.475876 tst mo_mt_sms.py: using BVCI 19722 06:57:34.586444 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:57:34.597143 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:57:34.607633 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:57:34.618154 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:57:34.628566 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:57:34.639148 tst sms:sysmo: Using 1 x modem (candidates: 2) 06:57:34.759555 tst sms:sysmo: Using 1 x modem (candidates: 2) 06:57:34.880680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:36.595467 run create_hlr_db(pid=4678): Launched 06:57:36.712804 bus /sierra_2: Setting Powered False 06:57:37.773306 run create_hlr_db(pid=4678): Terminated: ok {rc=0} 06:57:38.220078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4680): Launched 06:57:38.549078 run osmo-hlr_10.42.42.2(pid=4681): Launched 06:57:38.677844 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:41.245273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4683): Launched 06:57:41.574682 run osmo-stp_10.42.42.5(pid=4684): Launched 06:57:41.701744 run osmo-msc_10.42.42.6: Starting osmo-msc 06:57:47.170247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4686): Launched 06:57:47.480102 run osmo-msc_10.42.42.6(pid=4687): Launched 06:57:47.650770 run osmo-stp_10.42.42.5(pid=4684): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4684)] 06:57:47.778281 run osmo-stp_10.42.42.5(pid=4684): stdout: | (launched: 2022-12-09_06:57:41.513579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:47.907539 run osmo-stp_10.42.42.5(pid=4684): stderr: | 20221209065741709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065741709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065741710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065741710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065741712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065741713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065741713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:48.035801 run osmo-stp_10.42.42.5(pid=4684): stdout: | (launched: 2022-12-09_06:57:41.513579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:48.157242 run osmo-stp_10.42.42.5(pid=4684): stderr: | 20221209065741709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065741709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065741710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065741710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065741712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065741713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065741713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:48.302100 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4684): Process ended prematurely: osmo-stp_10.42.42.5(pid=4684) [trial-2356↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4684)] [trial-2356↪sms:sysmo↪mo_mt_sms.py:16] 06:57:48.310443 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 06:57:48.336608 run osmo-hlr_10.42.42.2(pid=4681): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4681)] 06:57:48.384748 run osmo-hlr_10.42.42.2(pid=4681): stdout: | (launched: 2022-12-09_06:57:38.487892) 06:57:48.434657 run osmo-hlr_10.42.42.2(pid=4681): stderr: | 20221209065738688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065738688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065738688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065738688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065738688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065738688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065738701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065738709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065738709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065738710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:57:48.504138 run osmo-msc_10.42.42.6(pid=4687): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4687)] 06:57:48.552502 run osmo-msc_10.42.42.6(pid=4687): stdout: | (launched: 2022-12-09_06:57:47.422793) 06:57:48.602488 run osmo-msc_10.42.42.6(pid=4687): stderr: | 20221209065747699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065747699 DLGLOBAL DEBUG validating counter group 0x7f5ac3364c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065747699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065747699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065747700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065747700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065747702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065747702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065747702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065747702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:57:48.652901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4680): Terminating (SIGTERM) 06:57:48.693214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4683): Terminating (SIGTERM) 06:57:48.733516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4686): Terminating (SIGTERM) 06:57:48.773562 --- ParallelTerminationStrategy: PID 4680 died... 06:57:48.792586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4680): Terminated: ok {rc=0} 06:57:48.836582 --- ParallelTerminationStrategy: PID 4683 died... 06:57:48.855204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4683): Terminated: ok {rc=0} 06:57:48.899619 --- ParallelTerminationStrategy: PID 4686 died... 06:57:48.918200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4686): Terminated: ok {rc=0} 06:57:49.004240 bus /sierra_3: Setting Powered False 06:57:50.106037 bus /sierra_3: Setting Powered False 06:57:51.223150 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:sysmo --------------------------------------------------------------------- 06:57:52.584089 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:52.588016 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 06:57:52.608937 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 06:57:52.615816 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 06:57:52.650971 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 06:57:52.672824 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 06:57:52.680255 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 06:57:53.201982 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 06:57:53.207198 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 06:57:53.218539 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 06:57:53.257086 tst assert_extension.py: using LAC 19722 06:57:53.385060 tst assert_extension.py: using RAC 87 06:57:53.511944 tst assert_extension.py: using CellId 19722 06:57:53.638673 tst assert_extension.py: using BVCI 19723 06:57:53.757772 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 06:57:53.877312 tst assert_extension.py:10: start nitb and bts... 06:57:54.097295 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:57:54.764439 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4692): Launched 06:57:55.091781 run osmo-nitb_10.42.42.2(pid=4693): Launched 06:57:55.274579 run osmo-nitb_10.42.42.2(pid=4693): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4693)] 06:57:55.420292 run osmo-nitb_10.42.42.2(pid=4693): stdout: | (launched: 2022-12-09_06:57:55.030274) 06:57:55.567637 run osmo-nitb_10.42.42.2(pid=4693): stderr: | (launched: 2022-12-09_06:57:55.078891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:57:55.715510 run osmo-nitb_10.42.42.2(pid=4693): stdout: | (launched: 2022-12-09_06:57:55.030274) 06:57:55.857233 run osmo-nitb_10.42.42.2(pid=4693): stderr: | (launched: 2022-12-09_06:57:55.078891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4693): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4693) [trial-2356↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4693)] 06:57:56.217151 tst osmo-nitb_10.42.42.2(pid=4693): stdout: | (launched: 2022-12-09_06:57:55.030274) 06:57:56.347883 tst osmo-nitb_10.42.42.2(pid=4693): stderr: | (launched: 2022-12-09_06:57:55.078891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:57:56.502628 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4693): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4693) [trial-2356↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4693)] [trial-2356↪nitb_ussd:sysmo↪assert_extension.py:12] 06:57:56.511619 tst assert_extension.py:12: Test FAILED (3.3 sec) 06:57:56.518927 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4692): Terminating (SIGTERM) 06:57:56.730405 --- ParallelTerminationStrategy: PID 4692 died... 06:57:56.752217 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4692): Terminated: ok {rc=0} 06:57:56.841816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:sysmo --------------------------------------------------------------------- 06:57:58.017871 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:58.022161 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 06:57:58.044034 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 06:57:58.072094 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 06:57:58.108817 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 06:57:58.130669 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 06:57:58.158470 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 06:57:58.685793 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:sysmo assert_extension.py ---------------------------------------------- 06:57:58.691070 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:58.702039 tst ussd:sysmo: Using 1 x bts (candidates: 1) 06:57:58.740375 tst assert_extension.py: using LAC 19723 06:57:58.858149 tst assert_extension.py: using RAC 88 06:57:58.977183 tst assert_extension.py: using CellId 19723 06:57:59.095384 tst assert_extension.py: using BVCI 19724 06:57:59.206885 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:59.217649 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:59.228263 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:59.239101 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:59.250222 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:59.260841 tst ussd:sysmo: Using 1 x modem (candidates: 1) 06:57:59.379338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:59.888836 run create_hlr_db(pid=4697): Launched 06:58:00.021647 bus /sierra_2: Setting Powered False 06:58:01.082416 run create_hlr_db(pid=4697): Terminated: ok {rc=0} 06:58:01.544664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4699): Launched 06:58:01.889634 run osmo-hlr_10.42.42.2(pid=4700): Launched 06:58:02.069780 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:02.654847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4702): Launched 06:58:02.962705 run osmo-stp_10.42.42.5(pid=4703): Launched 06:58:03.079559 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:03.632474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4705): Launched 06:58:03.940447 run osmo-msc_10.42.42.6(pid=4706): Launched 06:58:04.112071 run osmo-stp_10.42.42.5(pid=4703): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4703)] 06:58:04.242867 run osmo-stp_10.42.42.5(pid=4703): stdout: | (launched: 2022-12-09_06:58:02.904209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:04.373431 run osmo-stp_10.42.42.5(pid=4703): stderr: | 20221209065803077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065803077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065803077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065803078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065803080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065803080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065803080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:04.501028 run osmo-stp_10.42.42.5(pid=4703): stdout: | (launched: 2022-12-09_06:58:02.904209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:04.622632 run osmo-stp_10.42.42.5(pid=4703): stderr: | 20221209065803077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065803077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065803077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065803078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065803080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065803080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065803080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:04.767616 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4703): Process ended prematurely: osmo-stp_10.42.42.5(pid=4703) [trial-2356↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4703)] [trial-2356↪ussd:sysmo↪assert_extension.py:17] 06:58:04.776021 tst assert_extension.py:17: Test FAILED (6.1 sec) 06:58:04.802527 run osmo-hlr_10.42.42.2(pid=4700): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4700)] 06:58:04.852028 run osmo-hlr_10.42.42.2(pid=4700): stdout: | (launched: 2022-12-09_06:58:01.826111) 06:58:04.902574 run osmo-hlr_10.42.42.2(pid=4700): stderr: | 20221209065802166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065802166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065802166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065802166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065802166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065802166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065802178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065802190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065802190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065802190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:04.972742 run osmo-msc_10.42.42.6(pid=4706): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4706)] 06:58:05.021502 run osmo-msc_10.42.42.6(pid=4706): stdout: | (launched: 2022-12-09_06:58:03.882047) 06:58:05.072121 run osmo-msc_10.42.42.6(pid=4706): stderr: | 20221209065804156 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065804157 DLGLOBAL DEBUG validating counter group 0x7f67f23b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065804157 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065804157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065804157 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065804157 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065804159 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065804159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065804159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065804159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:05.123029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4699): Terminating (SIGTERM) 06:58:05.163379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4702): Terminating (SIGTERM) 06:58:05.203636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4705): Terminating (SIGTERM) 06:58:05.244374 --- ParallelTerminationStrategy: PID 4699 died... 06:58:05.263637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4699): Terminated: ok {rc=0} 06:58:05.308373 --- ParallelTerminationStrategy: PID 4702 died... 06:58:05.327360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4702): Terminated: ok {rc=0} 06:58:05.372147 --- ParallelTerminationStrategy: PID 4705 died... 06:58:05.390807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4705): Terminated: ok {rc=0} 06:58:05.478933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:58:06.675145 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:58:06.681944 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:58:06.703707 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:58:06.731579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:58:06.787521 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:58:06.810192 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:58:06.837385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:58:07.382793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:58:07.434271 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:07.445493 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:58:07.500531 tst mo_mt_call.py: using LAC 19724 06:58:07.620674 tst mo_mt_call.py: using RAC 89 06:58:07.739829 tst mo_mt_call.py: using CellId 19724 06:58:07.859835 tst mo_mt_call.py: using BVCI 19725 06:58:07.981351 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:07.993342 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:08.005106 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:08.017510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:08.029722 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:08.042177 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:58:08.163991 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:58:08.283340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:08.767889 run create_hlr_db(pid=4711): Launched 06:58:08.886981 bus /sierra_2: Setting Powered False 06:58:09.948775 run create_hlr_db(pid=4711): Terminated: ok {rc=0} 06:58:10.404608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4713): Launched 06:58:10.742564 run osmo-hlr_10.42.42.2(pid=4714): Launched 06:58:10.869376 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:11.445458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4716): Launched 06:58:11.778575 run osmo-stp_10.42.42.5(pid=4717): Launched 06:58:11.905311 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:12.505333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4719): Launched 06:58:12.839025 run osmo-msc_10.42.42.6(pid=4720): Launched 06:58:13.023774 run osmo-stp_10.42.42.5(pid=4717): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4717)] 06:58:13.164112 run osmo-stp_10.42.42.5(pid=4717): stdout: | (launched: 2022-12-09_06:58:11.716282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:13.304773 run osmo-stp_10.42.42.5(pid=4717): stderr: | 20221209065811912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065811912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065811912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065811913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065811913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065811913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065811913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:13.443359 run osmo-stp_10.42.42.5(pid=4717): stdout: | (launched: 2022-12-09_06:58:11.716282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:13.576067 run osmo-stp_10.42.42.5(pid=4717): stderr: | 20221209065811912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065811912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065811912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065811913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065811913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065811913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065811913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:13.735344 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4717): Process ended prematurely: osmo-stp_10.42.42.5(pid=4717) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4717)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:58:13.744751 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:58:13.772730 run osmo-hlr_10.42.42.2(pid=4714): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4714)] 06:58:13.823443 run osmo-hlr_10.42.42.2(pid=4714): stdout: | (launched: 2022-12-09_06:58:10.679854) 06:58:13.875879 run osmo-hlr_10.42.42.2(pid=4714): stderr: | 20221209065810882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065810882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065810882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065810882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065810882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065810882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065810894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065810905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065810905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065810905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:13.948712 run osmo-msc_10.42.42.6(pid=4720): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4720)] 06:58:13.999502 run osmo-msc_10.42.42.6(pid=4720): stdout: | (launched: 2022-12-09_06:58:12.776256) 06:58:14.051756 run osmo-msc_10.42.42.6(pid=4720): stderr: | 20221209065813101 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065813101 DLGLOBAL DEBUG validating counter group 0x7f78a80edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065813101 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065813101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065813101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065813102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065813103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065813104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065813104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065813104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:14.104491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4713): Terminating (SIGTERM) 06:58:14.146839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4716): Terminating (SIGTERM) 06:58:14.189131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4719): Terminating (SIGTERM) 06:58:14.231709 --- ParallelTerminationStrategy: PID 4713 died... 06:58:14.252232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4713): Terminated: ok {rc=0} 06:58:14.299170 --- ParallelTerminationStrategy: PID 4716 died... 06:58:14.318991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4716): Terminated: ok {rc=0} 06:58:14.365571 --- ParallelTerminationStrategy: PID 4719 died... 06:58:14.385220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4719): Terminated: ok {rc=0} 06:58:14.474452 bus /sierra_3: Setting Powered False 06:58:15.574741 bus /sierra_3: Setting Powered False 06:58:16.694838 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:58:17.850060 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:17.862408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:58:17.921850 tst mo_mt_call_osmux.py: using LAC 19725 06:58:18.044758 tst mo_mt_call_osmux.py: using RAC 90 06:58:18.165789 tst mo_mt_call_osmux.py: using CellId 19725 06:58:18.288428 tst mo_mt_call_osmux.py: using BVCI 19726 06:58:18.400833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:18.412042 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:18.423186 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:18.434506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:18.445853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:58:18.457153 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:58:18.577636 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:58:18.697399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:19.181569 run create_hlr_db(pid=4722): Launched 06:58:19.300296 bus /sierra_2: Setting Powered False 06:58:20.364906 run create_hlr_db(pid=4722): Terminated: ok {rc=0} 06:58:20.811801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4724): Launched 06:58:21.126533 run osmo-hlr_10.42.42.2(pid=4725): Launched 06:58:21.244738 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:21.794066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4727): Launched 06:58:22.105563 run osmo-stp_10.42.42.5(pid=4728): Launched 06:58:22.223747 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:22.785509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4730): Launched 06:58:23.096436 run osmo-msc_10.42.42.6(pid=4731): Launched 06:58:23.270541 run osmo-stp_10.42.42.5(pid=4728): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4728)] 06:58:23.401553 run osmo-stp_10.42.42.5(pid=4728): stdout: | (launched: 2022-12-09_06:58:22.046587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:23.531952 run osmo-stp_10.42.42.5(pid=4728): stderr: | 20221209065822220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065822220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065822220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065822221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065822221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065822221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065822221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:23.660511 run osmo-stp_10.42.42.5(pid=4728): stdout: | (launched: 2022-12-09_06:58:22.046587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:23.784136 run osmo-stp_10.42.42.5(pid=4728): stderr: | 20221209065822220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065822220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065822220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065822221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065822221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065822221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065822221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:23.932191 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4728): Process ended prematurely: osmo-stp_10.42.42.5(pid=4728) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4728)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:58:23.941118 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:58:23.968097 run osmo-hlr_10.42.42.2(pid=4725): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4725)] 06:58:24.016851 run osmo-hlr_10.42.42.2(pid=4725): stdout: | (launched: 2022-12-09_06:58:21.067173) 06:58:24.067153 run osmo-hlr_10.42.42.2(pid=4725): stderr: | 20221209065821245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065821245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065821245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065821245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065821245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065821245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065821259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065821267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065821268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065821268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:24.137724 run osmo-msc_10.42.42.6(pid=4731): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4731)] 06:58:24.186726 run osmo-msc_10.42.42.6(pid=4731): stdout: | (launched: 2022-12-09_06:58:23.037576) 06:58:24.237242 run osmo-msc_10.42.42.6(pid=4731): stderr: | 20221209065823313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065823313 DLGLOBAL DEBUG validating counter group 0x7f968bfacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065823313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065823313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065823313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065823313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065823315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065823315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065823316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065823316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:24.288127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4724): Terminating (SIGTERM) 06:58:24.328613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4727): Terminating (SIGTERM) 06:58:24.369066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4730): Terminating (SIGTERM) 06:58:24.410102 --- ParallelTerminationStrategy: PID 4724 died... 06:58:24.429380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4724): Terminated: ok {rc=0} 06:58:24.474733 --- ParallelTerminationStrategy: PID 4727 died... 06:58:24.493631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4727): Terminated: ok {rc=0} 06:58:24.539453 --- ParallelTerminationStrategy: PID 4730 died... 06:58:24.558514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4730): Terminated: ok {rc=0} 06:58:24.645493 bus /sierra_3: Setting Powered False 06:58:25.746091 bus /sierra_3: Setting Powered False 06:58:26.863123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:58:28.099434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:58:28.106431 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:58:28.129837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:58:28.157778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:58:28.212452 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:58:28.234152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:58:28.261745 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:58:28.817950 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:58:28.870702 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:28.882262 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:58:28.942953 tst mo_mt_call.py: using LAC 19726 06:58:29.071828 tst mo_mt_call.py: using RAC 91 06:58:29.199757 tst mo_mt_call.py: using CellId 19726 06:58:29.329428 tst mo_mt_call.py: using BVCI 19727 06:58:29.443578 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:29.454981 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:29.466107 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:29.477532 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:29.488798 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:29.500411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:58:29.620356 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:58:29.739702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:30.222570 run create_hlr_db(pid=4736): Launched 06:58:30.341133 bus /sierra_2: Setting Powered False 06:58:31.402212 run create_hlr_db(pid=4736): Terminated: ok {rc=0} 06:58:31.857827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4738): Launched 06:58:32.186183 run osmo-hlr_10.42.42.2(pid=4739): Launched 06:58:32.308073 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:32.870983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4741): Launched 06:58:33.182838 run osmo-stp_10.42.42.5(pid=4742): Launched 06:58:33.300753 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:33.867515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4744): Launched 06:58:34.179341 run osmo-msc_10.42.42.6(pid=4745): Launched 06:58:34.353205 run osmo-stp_10.42.42.5(pid=4742): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4742)] 06:58:34.484480 run osmo-stp_10.42.42.5(pid=4742): stdout: | (launched: 2022-12-09_06:58:33.124091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:34.615112 run osmo-stp_10.42.42.5(pid=4742): stderr: | 20221209065833298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065833298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065833298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065833299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065833299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065833299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065833300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:34.744086 run osmo-stp_10.42.42.5(pid=4742): stdout: | (launched: 2022-12-09_06:58:33.124091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:34.867805 run osmo-stp_10.42.42.5(pid=4742): stderr: | 20221209065833298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065833298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065833298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065833299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065833299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065833299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065833300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:35.016560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4742): Process ended prematurely: osmo-stp_10.42.42.5(pid=4742) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4742)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:58:35.025811 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:58:35.052759 run osmo-hlr_10.42.42.2(pid=4739): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4739)] 06:58:35.101240 run osmo-hlr_10.42.42.2(pid=4739): stdout: | (launched: 2022-12-09_06:58:32.122740) 06:58:35.151091 run osmo-hlr_10.42.42.2(pid=4739): stderr: | 20221209065832304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065832304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065832304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065832304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065832304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065832304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065832327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065832337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065832337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065832337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:35.220183 run osmo-msc_10.42.42.6(pid=4745): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4745)] 06:58:35.268115 run osmo-msc_10.42.42.6(pid=4745): stdout: | (launched: 2022-12-09_06:58:34.120245) 06:58:35.317870 run osmo-msc_10.42.42.6(pid=4745): stderr: | 20221209065834395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065834395 DLGLOBAL DEBUG validating counter group 0x7fe7eb052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065834396 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065834396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065834396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065834396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065834398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065834398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065834398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065834398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:35.367852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4738): Terminating (SIGTERM) 06:58:35.407600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4741): Terminating (SIGTERM) 06:58:35.447282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4744): Terminating (SIGTERM) 06:58:35.486961 --- ParallelTerminationStrategy: PID 4738 died... 06:58:35.505921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4738): Terminated: ok {rc=0} 06:58:35.550242 --- ParallelTerminationStrategy: PID 4741 died... 06:58:35.568635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4741): Terminated: ok {rc=0} 06:58:35.612661 --- ParallelTerminationStrategy: PID 4744 died... 06:58:35.631483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4744): Terminated: ok {rc=0} 06:58:35.718382 bus /sierra_3: Setting Powered False 06:58:36.817407 bus /sierra_3: Setting Powered False 06:58:37.933561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:58:39.080629 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:39.092613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:58:39.149644 tst mo_mt_call_osmux.py: using LAC 19727 06:58:39.272088 tst mo_mt_call_osmux.py: using RAC 92 06:58:39.394413 tst mo_mt_call_osmux.py: using CellId 19727 06:58:39.517600 tst mo_mt_call_osmux.py: using BVCI 19728 06:58:39.639668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:39.651489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:39.663291 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:39.675277 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:39.687079 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:58:39.698892 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:58:39.816374 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:58:39.936447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:40.420562 run create_hlr_db(pid=4748): Launched 06:58:40.540736 bus /sierra_2: Setting Powered False 06:58:41.602663 run create_hlr_db(pid=4748): Terminated: ok {rc=0} 06:58:42.036813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4750): Launched 06:58:42.349840 run osmo-hlr_10.42.42.2(pid=4751): Launched 06:58:42.468748 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:43.002439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4753): Launched 06:58:43.313434 run osmo-stp_10.42.42.5(pid=4754): Launched 06:58:43.431514 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:43.992843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4756): Launched 06:58:44.304111 run osmo-msc_10.42.42.6(pid=4757): Launched 06:58:44.478115 run osmo-stp_10.42.42.5(pid=4754): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4754)] 06:58:44.609627 run osmo-stp_10.42.42.5(pid=4754): stdout: | (launched: 2022-12-09_06:58:43.254456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:44.740228 run osmo-stp_10.42.42.5(pid=4754): stderr: | 20221209065843428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065843428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065843428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065843429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065843429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065843429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065843429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:44.869762 run osmo-stp_10.42.42.5(pid=4754): stdout: | (launched: 2022-12-09_06:58:43.254456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:44.993317 run osmo-stp_10.42.42.5(pid=4754): stderr: | 20221209065843428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065843428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065843428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065843429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065843429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065843429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065843429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:45.141964 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4754): Process ended prematurely: osmo-stp_10.42.42.5(pid=4754) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4754)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:58:45.150814 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:58:45.178618 run osmo-hlr_10.42.42.2(pid=4751): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4751)] 06:58:45.231244 run osmo-hlr_10.42.42.2(pid=4751): stdout: | (launched: 2022-12-09_06:58:42.290470) 06:58:45.283094 run osmo-hlr_10.42.42.2(pid=4751): stderr: | 20221209065842470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065842470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065842470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065842470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065842470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065842470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065842483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065842491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065842491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065842491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:45.355124 run osmo-msc_10.42.42.6(pid=4757): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4757)] 06:58:45.405324 run osmo-msc_10.42.42.6(pid=4757): stdout: | (launched: 2022-12-09_06:58:44.245378) 06:58:45.457068 run osmo-msc_10.42.42.6(pid=4757): stderr: | 20221209065844521 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065844521 DLGLOBAL DEBUG validating counter group 0x7f1137c87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065844521 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065844521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065844522 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065844522 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065844525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065844526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065844526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065844526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:45.509412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4750): Terminating (SIGTERM) 06:58:45.550866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4753): Terminating (SIGTERM) 06:58:45.592528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4756): Terminating (SIGTERM) 06:58:45.634906 --- ParallelTerminationStrategy: PID 4750 died... 06:58:45.654703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4750): Terminated: ok {rc=0} 06:58:45.701098 --- ParallelTerminationStrategy: PID 4753 died... 06:58:45.720617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4753): Terminated: ok {rc=0} 06:58:45.766631 --- ParallelTerminationStrategy: PID 4756 died... 06:58:45.786110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4756): Terminated: ok {rc=0} 06:58:45.881734 bus /sierra_3: Setting Powered False 06:58:46.979745 bus /sierra_3: Setting Powered False 06:58:48.096795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:58:49.335470 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:58:49.341934 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:58:49.363384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:58:49.391453 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:58:49.444036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:58:49.465175 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:58:49.495902 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:58:50.043454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:58:50.093879 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:50.105297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:58:50.161373 tst mo_mt_call.py: using LAC 19728 06:58:50.282583 tst mo_mt_call.py: using RAC 93 06:58:50.405153 tst mo_mt_call.py: using CellId 19728 06:58:50.526343 tst mo_mt_call.py: using BVCI 19729 06:58:50.640494 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:50.651853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:50.662888 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:50.674084 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:50.685361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:50.696596 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:58:50.817671 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:58:50.940802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:51.462523 run create_hlr_db(pid=4763): Launched 06:58:51.584906 bus /sierra_2: Setting Powered False 06:58:52.646823 run create_hlr_db(pid=4763): Terminated: ok {rc=0} 06:58:53.081446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4765): Launched 06:58:53.393986 run osmo-hlr_10.42.42.2(pid=4766): Launched 06:58:53.512330 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:54.046684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4768): Launched 06:58:54.358193 run osmo-stp_10.42.42.5(pid=4769): Launched 06:58:54.475792 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:55.037672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4771): Launched 06:58:55.349466 run osmo-msc_10.42.42.6(pid=4772): Launched 06:58:55.522393 run osmo-stp_10.42.42.5(pid=4769): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4769)] 06:58:55.653243 run osmo-stp_10.42.42.5(pid=4769): stdout: | (launched: 2022-12-09_06:58:54.299082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:55.783898 run osmo-stp_10.42.42.5(pid=4769): stderr: | 20221209065854473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065854473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065854473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065854473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065854474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065854474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065854474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:55.912364 run osmo-stp_10.42.42.5(pid=4769): stdout: | (launched: 2022-12-09_06:58:54.299082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:56.035579 run osmo-stp_10.42.42.5(pid=4769): stderr: | 20221209065854473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065854473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065854473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065854473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065854474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065854474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065854474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:56.183223 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4769): Process ended prematurely: osmo-stp_10.42.42.5(pid=4769) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4769)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:58:56.192164 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:58:56.218998 run osmo-hlr_10.42.42.2(pid=4766): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4766)] 06:58:56.267810 run osmo-hlr_10.42.42.2(pid=4766): stdout: | (launched: 2022-12-09_06:58:53.334907) 06:58:56.318011 run osmo-hlr_10.42.42.2(pid=4766): stderr: | 20221209065853514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065853514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065853514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065853514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065853514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065853514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065853527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065853535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065853535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065853535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:56.387927 run osmo-msc_10.42.42.6(pid=4772): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4772)] 06:58:56.436424 run osmo-msc_10.42.42.6(pid=4772): stdout: | (launched: 2022-12-09_06:58:55.290220) 06:58:56.486520 run osmo-msc_10.42.42.6(pid=4772): stderr: | 20221209065855566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065855566 DLGLOBAL DEBUG validating counter group 0x7fe8d31c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065855566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065855566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065855566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065855566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065855568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065855568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065855569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065855569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:56.536867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4765): Terminating (SIGTERM) 06:58:56.577666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4768): Terminating (SIGTERM) 06:58:56.617568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4771): Terminating (SIGTERM) 06:58:56.657737 --- ParallelTerminationStrategy: PID 4765 died... 06:58:56.676885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4765): Terminated: ok {rc=0} 06:58:56.721542 --- ParallelTerminationStrategy: PID 4768 died... 06:58:56.740133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4768): Terminated: ok {rc=0} 06:58:56.784864 --- ParallelTerminationStrategy: PID 4771 died... 06:58:56.803892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4771): Terminated: ok {rc=0} 06:58:56.889128 bus /sierra_3: Setting Powered False 06:58:57.988939 bus /sierra_3: Setting Powered False 06:58:59.107220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:59:00.259069 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:59:00.271325 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:59:00.330457 tst mo_mt_call_osmux.py: using LAC 19729 06:59:00.461404 tst mo_mt_call_osmux.py: using RAC 94 06:59:00.591891 tst mo_mt_call_osmux.py: using CellId 19729 06:59:00.725106 tst mo_mt_call_osmux.py: using BVCI 19730 06:59:00.867102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:59:00.879485 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:59:00.892112 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:59:00.904796 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:59:00.917506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:59:00.929786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:59:01.056179 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:59:01.180315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:01.708525 run create_hlr_db(pid=4774): Launched 06:59:01.875706 bus /sierra_2: Setting Powered False 06:59:02.941617 run create_hlr_db(pid=4774): Terminated: ok {rc=0} 06:59:03.405640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4776): Launched 06:59:03.740909 run osmo-hlr_10.42.42.2(pid=4777): Launched 06:59:03.867623 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:04.445447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4779): Launched 06:59:04.779044 run osmo-stp_10.42.42.5(pid=4780): Launched 06:59:04.905374 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:05.505905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4782): Launched 06:59:05.840170 run osmo-msc_10.42.42.6(pid=4783): Launched 06:59:06.025782 run osmo-stp_10.42.42.5(pid=4780): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4780)] 06:59:06.165438 run osmo-stp_10.42.42.5(pid=4780): stdout: | (launched: 2022-12-09_06:59:04.716666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:06.305553 run osmo-stp_10.42.42.5(pid=4780): stderr: | 20221209065904911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065904912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065904912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065904912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065904913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065904913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065904913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:06.443884 run osmo-stp_10.42.42.5(pid=4780): stdout: | (launched: 2022-12-09_06:59:04.716666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:06.575951 run osmo-stp_10.42.42.5(pid=4780): stderr: | 20221209065904911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065904912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065904912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065904912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065904913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065904913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065904913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:06.735232 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4780): Process ended prematurely: osmo-stp_10.42.42.5(pid=4780) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4780)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:59:06.744798 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:59:06.772656 run osmo-hlr_10.42.42.2(pid=4777): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4777)] 06:59:06.822906 run osmo-hlr_10.42.42.2(pid=4777): stdout: | (launched: 2022-12-09_06:59:03.678094) 06:59:06.874677 run osmo-hlr_10.42.42.2(pid=4777): stderr: | 20221209065903883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065903883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065903883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065903883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065903883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065903883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065903897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065903905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065903905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065903905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:06.947411 run osmo-msc_10.42.42.6(pid=4783): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4783)] 06:59:06.997558 run osmo-msc_10.42.42.6(pid=4783): stdout: | (launched: 2022-12-09_06:59:05.777328) 06:59:07.049386 run osmo-msc_10.42.42.6(pid=4783): stderr: | 20221209065906103 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065906103 DLGLOBAL DEBUG validating counter group 0x7f1d99a44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065906103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065906103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065906103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065906104 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065906105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065906106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065906106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065906106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:07.101548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4776): Terminating (SIGTERM) 06:59:07.143351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4779): Terminating (SIGTERM) 06:59:07.185299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4782): Terminating (SIGTERM) 06:59:07.227173 --- ParallelTerminationStrategy: PID 4776 died... 06:59:07.247251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4776): Terminated: ok {rc=0} 06:59:07.293499 --- ParallelTerminationStrategy: PID 4779 died... 06:59:07.313073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4779): Terminated: ok {rc=0} 06:59:07.359581 --- ParallelTerminationStrategy: PID 4782 died... 06:59:07.379159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4782): Terminated: ok {rc=0} 06:59:07.466461 bus /sierra_3: Setting Powered False 06:59:08.565169 bus /sierra_3: Setting Powered False 06:59:09.681373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:59:10.920335 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:10.926822 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:59:10.948571 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:59:10.975674 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:59:11.028997 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:59:11.050476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:59:11.077491 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:59:11.627044 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:59:11.677445 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:11.688473 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:59:11.748089 tst mo_mt_call.py: using LAC 19730 06:59:11.869428 tst mo_mt_call.py: using RAC 95 06:59:12.000070 tst mo_mt_call.py: using CellId 19730 06:59:12.122263 tst mo_mt_call.py: using BVCI 19731 06:59:12.236076 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:12.247234 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:12.258145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:12.269385 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:12.280509 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:12.291795 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:59:12.406521 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:59:12.528434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:13.050804 run create_hlr_db(pid=4788): Launched 06:59:13.187732 bus /sierra_2: Setting Powered False 06:59:14.252924 run create_hlr_db(pid=4788): Terminated: ok {rc=0} 06:59:14.716233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4790): Launched 06:59:15.050676 run osmo-hlr_10.42.42.2(pid=4791): Launched 06:59:15.177214 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:15.751125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4793): Launched 06:59:16.115964 run osmo-stp_10.42.42.5(pid=4794): Launched 06:59:16.428293 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:17.010742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4796): Launched 06:59:17.343904 run osmo-msc_10.42.42.6(pid=4797): Launched 06:59:17.521602 run osmo-stp_10.42.42.5(pid=4794): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4794)] 06:59:17.654114 run osmo-stp_10.42.42.5(pid=4794): stdout: | (launched: 2022-12-09_06:59:16.051348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:17.787037 run osmo-stp_10.42.42.5(pid=4794): stderr: | 20221209065916257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065916258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065916258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065916259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065916259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065916259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065916259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:17.917147 run osmo-stp_10.42.42.5(pid=4794): stdout: | (launched: 2022-12-09_06:59:16.051348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:18.040924 run osmo-stp_10.42.42.5(pid=4794): stderr: | 20221209065916257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065916258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065916258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065916259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065916259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065916259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065916259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:18.189311 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4794): Process ended prematurely: osmo-stp_10.42.42.5(pid=4794) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4794)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:59:18.198485 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 06:59:18.225433 run osmo-hlr_10.42.42.2(pid=4791): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4791)] 06:59:18.273920 run osmo-hlr_10.42.42.2(pid=4791): stdout: | (launched: 2022-12-09_06:59:14.988268) 06:59:18.324140 run osmo-hlr_10.42.42.2(pid=4791): stderr: | 20221209065915190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065915190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065915191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065915191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065915191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065915191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065915203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065915212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065915212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065915212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:18.393338 run osmo-msc_10.42.42.6(pid=4797): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4797)] 06:59:18.441377 run osmo-msc_10.42.42.6(pid=4797): stdout: | (launched: 2022-12-09_06:59:17.283999) 06:59:18.490995 run osmo-msc_10.42.42.6(pid=4797): stderr: | 20221209065917558 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065917558 DLGLOBAL DEBUG validating counter group 0x7f5ac4b70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065917558 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065917558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065917558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065917559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065917560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065917561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065917561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065917561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:18.541108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4790): Terminating (SIGTERM) 06:59:18.580855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4793): Terminating (SIGTERM) 06:59:18.620466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4796): Terminating (SIGTERM) 06:59:18.661020 --- ParallelTerminationStrategy: PID 4790 died... 06:59:18.679679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4790): Terminated: ok {rc=0} 06:59:18.724164 --- ParallelTerminationStrategy: PID 4793 died... 06:59:18.742881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4793): Terminated: ok {rc=0} 06:59:18.787185 --- ParallelTerminationStrategy: PID 4796 died... 06:59:18.805675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4796): Terminated: ok {rc=0} 06:59:18.891915 bus /sierra_3: Setting Powered False 06:59:19.990341 bus /sierra_3: Setting Powered False 06:59:21.106418 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:59:22.254369 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:22.266505 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:59:22.322587 tst mo_mt_call_osmux.py: using LAC 19731 06:59:22.443940 tst mo_mt_call_osmux.py: using RAC 96 06:59:22.567169 tst mo_mt_call_osmux.py: using CellId 19731 06:59:22.690733 tst mo_mt_call_osmux.py: using BVCI 19732 06:59:22.806050 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:22.817458 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:22.828571 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:22.839909 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:22.851311 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:59:22.862844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:59:22.983739 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:59:23.103729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:23.589589 run create_hlr_db(pid=4799): Launched 06:59:23.707249 bus /sierra_2: Setting Powered False 06:59:24.768723 run create_hlr_db(pid=4799): Terminated: ok {rc=0} 06:59:25.226453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4801): Launched 06:59:25.562578 run osmo-hlr_10.42.42.2(pid=4802): Launched 06:59:25.690004 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:26.266499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4804): Launched 06:59:26.602427 run osmo-stp_10.42.42.5(pid=4805): Launched 06:59:26.729917 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:27.335162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4807): Launched 06:59:27.671912 run osmo-msc_10.42.42.6(pid=4808): Launched 06:59:27.859344 run osmo-stp_10.42.42.5(pid=4805): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4805)] 06:59:27.999326 run osmo-stp_10.42.42.5(pid=4805): stdout: | (launched: 2022-12-09_06:59:26.539296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:28.139817 run osmo-stp_10.42.42.5(pid=4805): stderr: | 20221209065926736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065926736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065926737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065926737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065926737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065926738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065926738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:28.278342 run osmo-stp_10.42.42.5(pid=4805): stdout: | (launched: 2022-12-09_06:59:26.539296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:28.411128 run osmo-stp_10.42.42.5(pid=4805): stderr: | 20221209065926736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065926736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065926737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065926737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065926737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065926738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065926738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:28.569801 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4805): Process ended prematurely: osmo-stp_10.42.42.5(pid=4805) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4805)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:59:28.579588 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:59:28.607274 run osmo-hlr_10.42.42.2(pid=4802): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4802)] 06:59:28.657588 run osmo-hlr_10.42.42.2(pid=4802): stdout: | (launched: 2022-12-09_06:59:25.499534) 06:59:28.709997 run osmo-hlr_10.42.42.2(pid=4802): stderr: | 20221209065925702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065925702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065925702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065925702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065925702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065925702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065925714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065925723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065925723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065925723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:28.782132 run osmo-msc_10.42.42.6(pid=4808): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4808)] 06:59:28.832590 run osmo-msc_10.42.42.6(pid=4808): stdout: | (launched: 2022-12-09_06:59:27.609363) 06:59:28.884535 run osmo-msc_10.42.42.6(pid=4808): stderr: | 20221209065927937 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065927937 DLGLOBAL DEBUG validating counter group 0x7f5952b4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065927937 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065927937 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065927937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065927937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065927939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065927939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065927939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065927940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:28.936453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4801): Terminating (SIGTERM) 06:59:28.978043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4804): Terminating (SIGTERM) 06:59:29.020035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4807): Terminating (SIGTERM) 06:59:29.062070 --- ParallelTerminationStrategy: PID 4801 died... 06:59:29.082124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4801): Terminated: ok {rc=0} 06:59:29.128484 --- ParallelTerminationStrategy: PID 4804 died... 06:59:29.148147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4804): Terminated: ok {rc=0} 06:59:29.194304 --- ParallelTerminationStrategy: PID 4807 died... 06:59:29.213885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4807): Terminated: ok {rc=0} 06:59:29.301406 bus /sierra_3: Setting Powered False 06:59:30.401054 bus /sierra_3: Setting Powered False 06:59:31.529536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:59:32.792167 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:32.799975 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:59:32.822625 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:59:32.850223 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:59:32.900766 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:59:32.921727 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:59:32.949208 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:59:33.501524 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:59:33.551598 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:33.562911 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:59:33.617923 tst mo_mt_call.py: using LAC 19732 06:59:33.737888 tst mo_mt_call.py: using RAC 97 06:59:33.860136 tst mo_mt_call.py: using CellId 19732 06:59:33.980188 tst mo_mt_call.py: using BVCI 19733 06:59:34.092892 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:34.104493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:34.115439 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:34.126596 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:34.137744 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:34.149074 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:59:34.272003 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:59:34.390219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:34.877168 run create_hlr_db(pid=4813): Launched 06:59:34.995200 bus /sierra_2: Setting Powered False 06:59:36.056617 run create_hlr_db(pid=4813): Terminated: ok {rc=0} 06:59:36.512277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4815): Launched 06:59:36.847956 run osmo-hlr_10.42.42.2(pid=4816): Launched 06:59:36.978310 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:37.552836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4818): Launched 06:59:37.887751 run osmo-stp_10.42.42.5(pid=4819): Launched 06:59:38.014973 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:38.619508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4821): Launched 06:59:38.955353 run osmo-msc_10.42.42.6(pid=4822): Launched 06:59:39.140097 run osmo-stp_10.42.42.5(pid=4819): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4819)] 06:59:39.279364 run osmo-stp_10.42.42.5(pid=4819): stdout: | (launched: 2022-12-09_06:59:37.825358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:39.419320 run osmo-stp_10.42.42.5(pid=4819): stderr: | 20221209065938020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065938021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065938021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065938021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065938022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065938022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065938022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:39.558234 run osmo-stp_10.42.42.5(pid=4819): stdout: | (launched: 2022-12-09_06:59:37.825358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:39.691175 run osmo-stp_10.42.42.5(pid=4819): stderr: | 20221209065938020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065938021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065938021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065938021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065938022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065938022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065938022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:39.850659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4819): Process ended prematurely: osmo-stp_10.42.42.5(pid=4819) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4819)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:59:39.860428 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:59:39.889188 run osmo-hlr_10.42.42.2(pid=4816): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4816)] 06:59:39.940154 run osmo-hlr_10.42.42.2(pid=4816): stdout: | (launched: 2022-12-09_06:59:36.785462) 06:59:39.992895 run osmo-hlr_10.42.42.2(pid=4816): stderr: | 20221209065936989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065936989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065936989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065936989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065936989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065936989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065937001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065937010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065937010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065937010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:40.065964 run osmo-msc_10.42.42.6(pid=4822): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4822)] 06:59:40.116535 run osmo-msc_10.42.42.6(pid=4822): stdout: | (launched: 2022-12-09_06:59:38.892127) 06:59:40.168885 run osmo-msc_10.42.42.6(pid=4822): stderr: | 20221209065939218 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065939218 DLGLOBAL DEBUG validating counter group 0x7f9426af7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065939218 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065939218 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065939218 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065939219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065939220 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065939221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065939221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065939221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:40.221742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4815): Terminating (SIGTERM) 06:59:40.264345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4818): Terminating (SIGTERM) 06:59:40.306832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4821): Terminating (SIGTERM) 06:59:40.349865 --- ParallelTerminationStrategy: PID 4815 died... 06:59:40.370133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4815): Terminated: ok {rc=0} 06:59:40.417478 --- ParallelTerminationStrategy: PID 4818 died... 06:59:40.437498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4818): Terminated: ok {rc=0} 06:59:40.484736 --- ParallelTerminationStrategy: PID 4821 died... 06:59:40.504886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4821): Terminated: ok {rc=0} 06:59:40.594954 bus /sierra_3: Setting Powered False 06:59:41.694638 bus /sierra_3: Setting Powered False 06:59:42.813434 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:59:43.960743 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:43.972723 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:59:44.029655 tst mo_mt_call_osmux.py: using LAC 19733 06:59:44.161396 tst mo_mt_call_osmux.py: using RAC 98 06:59:44.291551 tst mo_mt_call_osmux.py: using CellId 19733 06:59:44.421462 tst mo_mt_call_osmux.py: using BVCI 19734 06:59:44.544030 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:44.555980 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:44.567869 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:44.579630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:44.591329 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:59:44.603129 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:59:44.720537 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:59:44.841376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:45.324436 run create_hlr_db(pid=4825): Launched 06:59:45.443913 bus /sierra_2: Setting Powered False 06:59:46.507730 run create_hlr_db(pid=4825): Terminated: ok {rc=0} 06:59:46.985319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4827): Launched 06:59:47.333649 run osmo-hlr_10.42.42.2(pid=4828): Launched 06:59:47.462973 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:48.038005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4830): Launched 06:59:48.374583 run osmo-stp_10.42.42.5(pid=4831): Launched 06:59:48.501157 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:49.107414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4833): Launched 06:59:49.442615 run osmo-msc_10.42.42.6(pid=4834): Launched 06:59:49.628426 run osmo-stp_10.42.42.5(pid=4831): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4831)] 06:59:49.768295 run osmo-stp_10.42.42.5(pid=4831): stdout: | (launched: 2022-12-09_06:59:48.311945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:49.908044 run osmo-stp_10.42.42.5(pid=4831): stderr: | 20221209065948510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065948510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065948510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065948510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065948511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065948511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065948511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:50.047246 run osmo-stp_10.42.42.5(pid=4831): stdout: | (launched: 2022-12-09_06:59:48.311945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:50.180680 run osmo-stp_10.42.42.5(pid=4831): stderr: | 20221209065948510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065948510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065948510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065948510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065948511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065948511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065948511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:50.340100 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4831): Process ended prematurely: osmo-stp_10.42.42.5(pid=4831) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4831)] [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:59:50.349943 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:59:50.378262 run osmo-hlr_10.42.42.2(pid=4828): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4828)] 06:59:50.429184 run osmo-hlr_10.42.42.2(pid=4828): stdout: | (launched: 2022-12-09_06:59:47.271036) 06:59:50.481237 run osmo-hlr_10.42.42.2(pid=4828): stderr: | 20221209065947473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065947473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065947473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065947473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065947473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065947473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065947485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065947494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065947495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065947495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:50.554015 run osmo-msc_10.42.42.6(pid=4834): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4834)] 06:59:50.604614 run osmo-msc_10.42.42.6(pid=4834): stdout: | (launched: 2022-12-09_06:59:49.379855) 06:59:50.656930 run osmo-msc_10.42.42.6(pid=4834): stderr: | 20221209065949710 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065949710 DLGLOBAL DEBUG validating counter group 0x7fc50052bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065949710 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065949710 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065949710 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065949710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065949712 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065949712 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065949713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065949713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:50.709722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4827): Terminating (SIGTERM) 06:59:50.752080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4830): Terminating (SIGTERM) 06:59:50.794449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4833): Terminating (SIGTERM) 06:59:50.836812 --- ParallelTerminationStrategy: PID 4827 died... 06:59:50.856926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4827): Terminated: ok {rc=0} 06:59:50.903634 --- ParallelTerminationStrategy: PID 4830 died... 06:59:50.923336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4830): Terminated: ok {rc=0} 06:59:50.969984 --- ParallelTerminationStrategy: PID 4833 died... 06:59:50.989851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4833): Terminated: ok {rc=0} 06:59:51.078939 bus /sierra_3: Setting Powered False 06:59:52.179124 bus /sierra_3: Setting Powered False 06:59:53.296085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:59:54.535955 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:54.544207 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:59:54.566269 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:59:54.594716 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:59:54.650811 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:59:54.673250 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:59:54.700802 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:59:55.252070 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:59:55.306219 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:55.318221 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:59:55.377413 tst mo_mt_call.py: using LAC 19734 06:59:55.508290 tst mo_mt_call.py: using RAC 99 06:59:55.639057 tst mo_mt_call.py: using CellId 19734 06:59:55.772160 tst mo_mt_call.py: using BVCI 19735 06:59:55.893177 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:55.904872 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:55.916430 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:55.928135 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:55.939842 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:55.951581 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:59:56.069695 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:59:56.188158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:56.673455 run create_hlr_db(pid=4839): Launched 06:59:56.792063 bus /sierra_2: Setting Powered False 06:59:57.854357 run create_hlr_db(pid=4839): Terminated: ok {rc=0} 06:59:58.290970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Launched 06:59:58.604230 run osmo-hlr_10.42.42.2(pid=4842): Launched 06:59:58.723217 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:59.301233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4844): Launched 06:59:59.636672 run osmo-stp_10.42.42.5(pid=4845): Launched 06:59:59.763821 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:00.367737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4847): Launched 07:00:00.703723 run osmo-msc_10.42.42.6(pid=4848): Launched 07:00:00.930517 run osmo-stp_10.42.42.5(pid=4845): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4845)] 07:00:01.155552 run osmo-stp_10.42.42.5(pid=4845): stdout: | (launched: 2022-12-09_06:59:59.574272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:01.404069 run osmo-stp_10.42.42.5(pid=4845): stderr: | 20221209065959773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065959773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065959773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065959773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065959774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065959774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065959774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:01.547984 run osmo-stp_10.42.42.5(pid=4845): stdout: | (launched: 2022-12-09_06:59:59.574272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:01.689810 run osmo-stp_10.42.42.5(pid=4845): stderr: | 20221209065959773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065959773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065959773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065959773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065959774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065959774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065959774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:01.863325 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4845): Process ended prematurely: osmo-stp_10.42.42.5(pid=4845) [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4845)] [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:00:01.874057 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:00:01.903712 run osmo-hlr_10.42.42.2(pid=4842): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4842)] 07:00:01.955472 run osmo-hlr_10.42.42.2(pid=4842): stdout: | (launched: 2022-12-09_06:59:58.545126) 07:00:02.009594 run osmo-hlr_10.42.42.2(pid=4842): stderr: | 20221209065958726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065958726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065958726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065958726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065958726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065958726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065958739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065958749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065958750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065958750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:02.083961 run osmo-msc_10.42.42.6(pid=4848): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4848)] 07:00:02.135465 run osmo-msc_10.42.42.6(pid=4848): stdout: | (launched: 2022-12-09_07:00:00.640895) 07:00:02.188801 run osmo-msc_10.42.42.6(pid=4848): stderr: | 20221209070001142 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070001142 DLGLOBAL DEBUG validating counter group 0x7f0e2d4d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070001142 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070001142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070001142 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070001142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070001144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070001153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070001153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070001153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:02.242618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Terminating (SIGTERM) 07:00:02.286412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4844): Terminating (SIGTERM) 07:00:02.331945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4847): Terminating (SIGTERM) 07:00:02.375313 --- ParallelTerminationStrategy: PID 4841 died... 07:00:02.395444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Terminated: ok {rc=0} 07:00:02.442738 --- ParallelTerminationStrategy: PID 4844 died... 07:00:02.462764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4844): Terminated: ok {rc=0} 07:00:02.510016 --- ParallelTerminationStrategy: PID 4847 died... 07:00:02.530000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4847): Terminated: ok {rc=0} 07:00:02.619770 bus /sierra_3: Setting Powered False 07:00:03.720446 bus /sierra_3: Setting Powered False 07:00:04.838436 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:00:05.991170 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:00:06.003904 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:00:06.063700 tst mo_mt_call_osmux.py: using LAC 19735 07:00:06.195642 tst mo_mt_call_osmux.py: using RAC 100 07:00:06.328942 tst mo_mt_call_osmux.py: using CellId 19735 07:00:06.459622 tst mo_mt_call_osmux.py: using BVCI 19736 07:00:06.582467 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:00:06.594374 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:00:06.606041 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:00:06.617804 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:00:06.629547 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:00:06.641337 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:00:06.762016 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:00:06.884813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:07.403837 run create_hlr_db(pid=4853): Launched 07:00:07.539931 bus /sierra_2: Setting Powered False 07:00:08.605988 run create_hlr_db(pid=4853): Terminated: ok {rc=0} 07:00:09.051743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4855): Launched 07:00:09.366265 run osmo-hlr_10.42.42.2(pid=4856): Launched 07:00:09.484701 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:10.033217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4858): Launched 07:00:10.346154 run osmo-stp_10.42.42.5(pid=4859): Launched 07:00:10.464118 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:11.025701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4861): Launched 07:00:11.339816 run osmo-msc_10.42.42.6(pid=4862): Launched 07:00:11.514417 run osmo-stp_10.42.42.5(pid=4859): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4859)] 07:00:11.647198 run osmo-stp_10.42.42.5(pid=4859): stdout: | (launched: 2022-12-09_07:00:10.287027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:11.778510 run osmo-stp_10.42.42.5(pid=4859): stderr: | 20221209070010461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070010462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070010462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070010462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070010463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070010463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070010463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:11.907608 run osmo-stp_10.42.42.5(pid=4859): stdout: | (launched: 2022-12-09_07:00:10.287027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:12.031453 run osmo-stp_10.42.42.5(pid=4859): stderr: | 20221209070010461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070010462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070010462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070010462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070010463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070010463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070010463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:12.179503 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4859): Process ended prematurely: osmo-stp_10.42.42.5(pid=4859) [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4859)] [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:00:12.188565 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:00:12.215885 run osmo-hlr_10.42.42.2(pid=4856): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4856)] 07:00:12.263759 run osmo-hlr_10.42.42.2(pid=4856): stdout: | (launched: 2022-12-09_07:00:09.306925) 07:00:12.313324 run osmo-hlr_10.42.42.2(pid=4856): stderr: | 20221209070009488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070009488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070009488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070009488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070009488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070009488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070009500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070009509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070009509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070009509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:12.382463 run osmo-msc_10.42.42.6(pid=4862): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4862)] 07:00:12.430395 run osmo-msc_10.42.42.6(pid=4862): stdout: | (launched: 2022-12-09_07:00:11.280391) 07:00:12.479790 run osmo-msc_10.42.42.6(pid=4862): stderr: | 20221209070011556 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070011556 DLGLOBAL DEBUG validating counter group 0x7ff56c899c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070011556 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070011556 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070011556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070011557 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070011558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070011559 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070011559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070011559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:12.529639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4855): Terminating (SIGTERM) 07:00:12.569316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4858): Terminating (SIGTERM) 07:00:12.609206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4861): Terminating (SIGTERM) 07:00:12.649150 --- ParallelTerminationStrategy: PID 4855 died... 07:00:12.668123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4855): Terminated: ok {rc=0} 07:00:12.712584 --- ParallelTerminationStrategy: PID 4858 died... 07:00:12.731138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4858): Terminated: ok {rc=0} 07:00:12.775332 --- ParallelTerminationStrategy: PID 4861 died... 07:00:12.793773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4861): Terminated: ok {rc=0} 07:00:12.879592 bus /sierra_3: Setting Powered False 07:00:13.979757 bus /sierra_3: Setting Powered False 07:00:15.096550 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:00:16.357409 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:00:16.366505 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:00:16.395987 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:00:16.431663 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:00:16.501275 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:00:16.523920 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:00:16.553749 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:00:17.106565 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:00:17.176864 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:17.191014 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:00:17.251652 tst mo_mt_call.py: using LAC 19736 07:00:17.383248 tst mo_mt_call.py: using RAC 101 07:00:17.519381 tst mo_mt_call.py: using CellId 19736 07:00:17.648758 tst mo_mt_call.py: using BVCI 19737 07:00:17.770069 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:17.781752 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:17.793129 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:17.804918 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:17.816909 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:17.828695 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:00:17.950120 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:00:18.075622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:18.594967 run create_hlr_db(pid=4867): Launched 07:00:18.731985 bus /sierra_2: Setting Powered False 07:00:19.797417 run create_hlr_db(pid=4867): Terminated: ok {rc=0} 07:00:20.262314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4869): Launched 07:00:20.597373 run osmo-hlr_10.42.42.2(pid=4870): Launched 07:00:20.724356 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:21.299114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4872): Launched 07:00:21.634801 run osmo-stp_10.42.42.5(pid=4873): Launched 07:00:21.762570 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:22.367312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4875): Launched 07:00:22.702109 run osmo-msc_10.42.42.6(pid=4876): Launched 07:00:22.890621 run osmo-stp_10.42.42.5(pid=4873): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4873)] 07:00:23.031161 run osmo-stp_10.42.42.5(pid=4873): stdout: | (launched: 2022-12-09_07:00:21.572095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:23.172111 run osmo-stp_10.42.42.5(pid=4873): stderr: | 20221209070021769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070021769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070021769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070021770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070021770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070021770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070021770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:23.311627 run osmo-stp_10.42.42.5(pid=4873): stdout: | (launched: 2022-12-09_07:00:21.572095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:23.444686 run osmo-stp_10.42.42.5(pid=4873): stderr: | 20221209070021769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070021769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070021769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070021770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070021770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070021770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070021770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:23.603725 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4873): Process ended prematurely: osmo-stp_10.42.42.5(pid=4873) [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4873)] [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:00:23.613581 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:00:23.641697 run osmo-hlr_10.42.42.2(pid=4870): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4870)] 07:00:23.692699 run osmo-hlr_10.42.42.2(pid=4870): stdout: | (launched: 2022-12-09_07:00:20.534937) 07:00:23.746329 run osmo-hlr_10.42.42.2(pid=4870): stderr: | 20221209070020738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070020739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070020739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070020739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070020739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070020739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070020751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070020759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070020759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070020759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:23.819436 run osmo-msc_10.42.42.6(pid=4876): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4876)] 07:00:23.870100 run osmo-msc_10.42.42.6(pid=4876): stdout: | (launched: 2022-12-09_07:00:22.639507) 07:00:23.922804 run osmo-msc_10.42.42.6(pid=4876): stderr: | 20221209070022966 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070022966 DLGLOBAL DEBUG validating counter group 0x7fc3e0964c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070022966 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070022966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070022966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070022966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070022968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070022968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070022969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070022969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:23.975638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4869): Terminating (SIGTERM) 07:00:24.017970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4872): Terminating (SIGTERM) 07:00:24.060293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4875): Terminating (SIGTERM) 07:00:24.102938 --- ParallelTerminationStrategy: PID 4869 died... 07:00:24.123596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4869): Terminated: ok {rc=0} 07:00:24.171582 --- ParallelTerminationStrategy: PID 4872 died... 07:00:24.191739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4872): Terminated: ok {rc=0} 07:00:24.238718 --- ParallelTerminationStrategy: PID 4875 died... 07:00:24.258601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4875): Terminated: ok {rc=0} 07:00:24.347764 bus /sierra_3: Setting Powered False 07:00:25.448218 bus /sierra_3: Setting Powered False 07:00:26.565071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:00:27.718111 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:27.730962 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:00:27.790415 tst mo_mt_call_osmux.py: using LAC 19737 07:00:27.921858 tst mo_mt_call_osmux.py: using RAC 102 07:00:28.059828 tst mo_mt_call_osmux.py: using CellId 19737 07:00:28.200145 tst mo_mt_call_osmux.py: using BVCI 19738 07:00:28.322642 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:28.334437 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:28.345830 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:28.357116 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:28.368351 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:00:28.380404 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:00:28.502347 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:00:28.622143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:29.107104 run create_hlr_db(pid=4878): Launched 07:00:29.226928 bus /sierra_2: Setting Powered False 07:00:30.288014 run create_hlr_db(pid=4878): Terminated: ok {rc=0} 07:00:30.745506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4880): Launched 07:00:31.103256 run osmo-hlr_10.42.42.2(pid=4881): Launched 07:00:31.368218 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:32.014716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4883): Launched 07:00:32.362767 run osmo-stp_10.42.42.5(pid=4884): Launched 07:00:32.489991 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:33.095832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4886): Launched 07:00:33.432636 run osmo-msc_10.42.42.6(pid=4887): Launched 07:00:33.617586 run osmo-stp_10.42.42.5(pid=4884): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4884)] 07:00:33.757678 run osmo-stp_10.42.42.5(pid=4884): stdout: | (launched: 2022-12-09_07:00:32.300081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:33.897287 run osmo-stp_10.42.42.5(pid=4884): stderr: | 20221209070032495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070032495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070032496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070032496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070032497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070032497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070032497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:34.037383 run osmo-stp_10.42.42.5(pid=4884): stdout: | (launched: 2022-12-09_07:00:32.300081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:34.170056 run osmo-stp_10.42.42.5(pid=4884): stderr: | 20221209070032495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070032495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070032496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070032496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070032497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070032497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070032497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:34.328823 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4884): Process ended prematurely: osmo-stp_10.42.42.5(pid=4884) [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4884)] [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:00:34.338843 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:00:34.366836 run osmo-hlr_10.42.42.2(pid=4881): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4881)] 07:00:34.417664 run osmo-hlr_10.42.42.2(pid=4881): stdout: | (launched: 2022-12-09_07:00:31.038259) 07:00:34.470226 run osmo-hlr_10.42.42.2(pid=4881): stderr: | 20221209070031278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070031278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070031278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070031278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070031278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070031278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070031302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070031310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070031310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070031311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:34.543091 run osmo-msc_10.42.42.6(pid=4887): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4887)] 07:00:34.593559 run osmo-msc_10.42.42.6(pid=4887): stdout: | (launched: 2022-12-09_07:00:33.370194) 07:00:34.645578 run osmo-msc_10.42.42.6(pid=4887): stderr: | 20221209070033699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070033699 DLGLOBAL DEBUG validating counter group 0x7fafe4c94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070033699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070033700 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070033700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070033700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070033702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070033702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070033702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070033702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:34.698157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4880): Terminating (SIGTERM) 07:00:34.740794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4883): Terminating (SIGTERM) 07:00:34.783255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4886): Terminating (SIGTERM) 07:00:34.825766 --- ParallelTerminationStrategy: PID 4880 died... 07:00:34.845931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4880): Terminated: ok {rc=0} 07:00:34.892587 --- ParallelTerminationStrategy: PID 4883 died... 07:00:34.912300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4883): Terminated: ok {rc=0} 07:00:34.959130 --- ParallelTerminationStrategy: PID 4886 died... 07:00:34.978741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4886): Terminated: ok {rc=0} 07:00:35.066917 bus /sierra_3: Setting Powered False 07:00:36.166889 bus /sierra_3: Setting Powered False 07:00:37.282892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:sysmo --------------------------------------------------------------------- 07:00:38.520438 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:00:38.525110 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 07:00:38.546912 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 07:00:38.574852 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 07:00:38.663411 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 07:00:38.685112 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 07:00:38.712733 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 07:00:39.299136 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 07:00:39.304346 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:39.315615 tst emergency:sysmo: Using 1 x bts (candidates: 1) 07:00:39.352679 tst emergency_mo_mt_call.py: using LAC 19738 07:00:39.476231 tst emergency_mo_mt_call.py: using RAC 103 07:00:39.598539 tst emergency_mo_mt_call.py: using CellId 19738 07:00:39.718149 tst emergency_mo_mt_call.py: using BVCI 19739 07:00:39.831336 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:39.842154 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:39.852924 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:39.863742 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:39.874623 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:39.885461 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:00:40.005881 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:00:40.124499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:40.602132 run create_hlr_db(pid=4894): Launched 07:00:40.718096 bus /sierra_2: Setting Powered False 07:00:41.778602 run create_hlr_db(pid=4894): Terminated: ok {rc=0} 07:00:42.228235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4896): Launched 07:00:42.558630 run osmo-hlr_10.42.42.2(pid=4897): Launched 07:00:42.685823 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:43.257703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4899): Launched 07:00:43.588324 run osmo-stp_10.42.42.5(pid=4900): Launched 07:00:43.723902 tst emergency_mo_mt_call.py: using MSISDN 7082 07:00:43.894174 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:44.484334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4902): Launched 07:00:44.813611 run osmo-msc_10.42.42.6(pid=4903): Launched 07:00:44.995992 run osmo-stp_10.42.42.5(pid=4900): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4900)] 07:00:45.133310 run osmo-stp_10.42.42.5(pid=4900): stdout: | (launched: 2022-12-09_07:00:43.526224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:45.271258 run osmo-stp_10.42.42.5(pid=4900): stderr: | 20221209070043722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070043722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070043722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070043723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070043725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070043725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070043725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:45.408770 run osmo-stp_10.42.42.5(pid=4900): stdout: | (launched: 2022-12-09_07:00:43.526224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:45.539355 run osmo-stp_10.42.42.5(pid=4900): stderr: | 20221209070043722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070043722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070043722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070043723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070043725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070043725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070043725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:45.694411 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4900): Process ended prematurely: osmo-stp_10.42.42.5(pid=4900) [trial-2356↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4900)] [trial-2356↪emergency:sysmo↪emergency_mo_mt_call.py:19] 07:00:45.703370 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 07:00:45.730803 run osmo-hlr_10.42.42.2(pid=4897): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4897)] 07:00:45.781971 run osmo-hlr_10.42.42.2(pid=4897): stdout: | (launched: 2022-12-09_07:00:42.496493) 07:00:45.834243 run osmo-hlr_10.42.42.2(pid=4897): stderr: | 20221209070042700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070042700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070042700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070042700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070042700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070042700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070042713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070042721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070042722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070042722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:45.913415 run osmo-msc_10.42.42.6(pid=4903): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4903)] 07:00:45.964664 run osmo-msc_10.42.42.6(pid=4903): stdout: | (launched: 2022-12-09_07:00:44.751459) 07:00:46.017189 run osmo-msc_10.42.42.6(pid=4903): stderr: | 20221209070045079 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070045079 DLGLOBAL DEBUG validating counter group 0x7f91855b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070045079 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070045079 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070045079 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070045080 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070045082 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070045082 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070045082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070045082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:46.069728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4896): Terminating (SIGTERM) 07:00:46.112705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4899): Terminating (SIGTERM) 07:00:46.157573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4902): Terminating (SIGTERM) 07:00:46.202168 --- ParallelTerminationStrategy: PID 4896 died... 07:00:46.222565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4896): Terminated: ok {rc=0} 07:00:46.269956 --- ParallelTerminationStrategy: PID 4899 died... 07:00:46.290713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4899): Terminated: ok {rc=0} 07:00:46.338450 --- ParallelTerminationStrategy: PID 4902 died... 07:00:46.358640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4902): Terminated: ok {rc=0} 07:00:46.449701 bus /sierra_3: Setting Powered False 07:00:47.548913 bus /sierra_3: Setting Powered False 07:00:48.666394 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 07:00:49.752934 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:49.765153 tst emergency:sysmo: Using 1 x bts (candidates: 1) 07:00:49.808658 tst emergency_preemptive_call.py: using LAC 19739 07:00:49.929263 tst emergency_preemptive_call.py: using RAC 104 07:00:50.050057 tst emergency_preemptive_call.py: using CellId 19739 07:00:50.170036 tst emergency_preemptive_call.py: using BVCI 19740 07:00:50.282128 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:50.292928 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:50.303613 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:50.314633 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:50.325587 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:00:50.336223 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:00:50.452430 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:00:50.575640 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:00:50.696083 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:00:50.812516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:51.288537 run create_hlr_db(pid=4905): Launched 07:00:51.405594 bus /sierra_2: Setting Powered False 07:00:52.470823 run create_hlr_db(pid=4905): Terminated: ok {rc=0} 07:00:52.927310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4907): Launched 07:00:53.256694 run osmo-hlr_10.42.42.2(pid=4908): Launched 07:00:53.382570 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:53.950132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4910): Launched 07:00:54.279252 run osmo-stp_10.42.42.5(pid=4911): Launched 07:00:54.416302 tst emergency_preemptive_call.py: using MSISDN 7083 07:00:54.585690 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:55.175329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4913): Launched 07:00:55.504340 run osmo-msc_10.42.42.6(pid=4914): Launched 07:00:55.697100 run osmo-stp_10.42.42.5(pid=4911): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4911)] 07:00:55.835568 run osmo-stp_10.42.42.5(pid=4911): stdout: | (launched: 2022-12-09_07:00:54.217462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:55.974378 run osmo-stp_10.42.42.5(pid=4911): stderr: | 20221209070054411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070054411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070054412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070054412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070054413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070054413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070054413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:56.111650 run osmo-stp_10.42.42.5(pid=4911): stdout: | (launched: 2022-12-09_07:00:54.217462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:56.241785 run osmo-stp_10.42.42.5(pid=4911): stderr: | 20221209070054411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070054411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070054412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070054412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070054413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070054413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070054413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:56.397865 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4911): Process ended prematurely: osmo-stp_10.42.42.5(pid=4911) [trial-2356↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4911)] [trial-2356↪emergency:sysmo↪emergency_preemptive_call.py:32] 07:00:56.406776 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 07:00:56.434210 run osmo-hlr_10.42.42.2(pid=4908): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4908)] 07:00:56.484574 run osmo-hlr_10.42.42.2(pid=4908): stdout: | (launched: 2022-12-09_07:00:53.195007) 07:00:56.536667 run osmo-hlr_10.42.42.2(pid=4908): stderr: | 20221209070053398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070053398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070053398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070053398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070053398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070053398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070053455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070053464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070053464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070053465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:56.609385 run osmo-msc_10.42.42.6(pid=4914): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4914)] 07:00:56.659705 run osmo-msc_10.42.42.6(pid=4914): stdout: | (launched: 2022-12-09_07:00:55.442208) 07:00:56.711772 run osmo-msc_10.42.42.6(pid=4914): stderr: | 20221209070055768 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070055768 DLGLOBAL DEBUG validating counter group 0x7f55adf84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070055768 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070055769 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070055769 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070055769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070055771 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070055771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070055771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070055771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:56.764700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4907): Terminating (SIGTERM) 07:00:56.806996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4910): Terminating (SIGTERM) 07:00:56.848918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4913): Terminating (SIGTERM) 07:00:56.891216 --- ParallelTerminationStrategy: PID 4907 died... 07:00:56.911318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4907): Terminated: ok {rc=0} 07:00:56.957737 --- ParallelTerminationStrategy: PID 4910 died... 07:00:56.977378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4910): Terminated: ok {rc=0} 07:00:57.023815 --- ParallelTerminationStrategy: PID 4913 died... 07:00:57.043504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4913): Terminated: ok {rc=0} 07:00:57.131920 bus /sierra_9: Setting Powered False 07:00:58.232135 bus /sierra_9: Setting Powered False 07:00:59.349381 bus /sierra_8: Setting Powered False 07:01:00.448224 bus /sierra_8: Setting Powered False 07:01:01.568277 bus /sierra_3: Setting Powered False 07:01:02.670560 bus /sierra_3: Setting Powered False 07:01:03.788223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:sysmo --------------------------------------------------------------------- 07:01:05.047457 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:01:05.053602 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 07:01:05.076387 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 07:01:05.116873 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 07:01:05.208341 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 07:01:05.230392 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 07:01:05.269990 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 07:01:05.858516 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 07:01:05.910734 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:05.921638 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:01:05.957932 tst cs_paging_gprs_active.py: using LAC 19740 07:01:06.081561 tst cs_paging_gprs_active.py: using RAC 105 07:01:06.215162 tst cs_paging_gprs_active.py: using CellId 19740 07:01:06.348291 tst cs_paging_gprs_active.py: using BVCI 19741 07:01:06.471506 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.482736 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.494056 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.505253 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.516222 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.527128 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.538305 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.549264 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:06.560418 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:06.677469 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:06.797125 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:01:07.006970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:07.323399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4920): Launched 07:01:07.597886 run iperf3-srv_10.42.42.10(pid=4921): Launched 07:01:07.714843 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:01:07.923086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:08.236713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4922): Launched 07:01:08.508076 run iperf3-srv_10.42.42.10(pid=4923): Launched 07:01:08.624350 tst cs_paging_gprs_active.py:38: start network... 07:01:08.832065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:09.314852 run create_hlr_db(pid=4924): Launched 07:01:09.434378 bus /sierra_2: Setting Powered False 07:01:10.496151 run create_hlr_db(pid=4924): Terminated: ok {rc=0} 07:01:10.931117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Launched 07:01:11.245311 run osmo-hlr_10.42.42.2(pid=4927): Launched 07:01:11.364562 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:11.912908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Launched 07:01:12.224602 run osmo-stp_10.42.42.5(pid=4930): Launched 07:01:12.342723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:13.858369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4932): Launched 07:01:13.977239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:14.242850 run patchelf(pid=4933): Launched 07:01:14.415929 run osmo-stp_10.42.42.5(pid=4930): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] 07:01:14.547544 run osmo-stp_10.42.42.5(pid=4930): stdout: | (launched: 2022-12-09_07:01:12.165632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:14.681214 run osmo-stp_10.42.42.5(pid=4930): stderr: | 20221209070112338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070112338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070112338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070112339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070112339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070112339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070112339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:14.814525 run osmo-stp_10.42.42.5(pid=4930): stdout: | (launched: 2022-12-09_07:01:12.165632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:14.941997 run osmo-stp_10.42.42.5(pid=4930): stderr: | 20221209070112338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070112338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070112338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070112339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070112339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070112339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070112339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:15.093405 run patchelf(pid=4933): Terminating (SIGINT) 07:01:15.267586 run patchelf(pid=4933): Terminated: ok {rc=0} 07:01:15.393264 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4930): Process ended prematurely: osmo-stp_10.42.42.5(pid=4930) [trial-2356↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] [trial-2356↪gprs:sysmo↪cs_paging_gprs_active.py:38] 07:01:15.402720 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 07:01:15.430802 run osmo-hlr_10.42.42.2(pid=4927): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4927)] 07:01:15.479519 run osmo-hlr_10.42.42.2(pid=4927): stdout: | (launched: 2022-12-09_07:01:11.185654) 07:01:15.529765 run osmo-hlr_10.42.42.2(pid=4927): stderr: | 20221209070111365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070111365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070111365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070111365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070111365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070111365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070111378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070111388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070111388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070111388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:15.580544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4920): Terminating (SIGTERM) 07:01:15.621102 run iperf3-srv_10.42.42.10(pid=4921): Terminating (SIGTERM) 07:01:15.661675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4922): Terminating (SIGTERM) 07:01:15.702221 run iperf3-srv_10.42.42.10(pid=4923): Terminating (SIGTERM) 07:01:15.742535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Terminating (SIGTERM) 07:01:15.782735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Terminating (SIGTERM) 07:01:15.823093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4932): Terminating (SIGTERM) 07:01:15.880311 --- ParallelTerminationStrategy: PID 4920 died... 07:01:15.903969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4920): Terminated: ok {rc=0} 07:01:15.966941 --- ParallelTerminationStrategy: PID 4921 died... 07:01:15.988302 run iperf3-srv_10.42.42.10(pid=4921): Terminated {rc=256} 07:01:16.038684 --- ParallelTerminationStrategy: PID 4922 died... 07:01:16.059678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4922): Terminated: ok {rc=0} 07:01:16.111784 --- ParallelTerminationStrategy: PID 4923 died... 07:01:16.132851 run iperf3-srv_10.42.42.10(pid=4923): Terminated {rc=256} 07:01:16.183384 --- ParallelTerminationStrategy: PID 4926 died... 07:01:16.204463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Terminated: ok {rc=0} 07:01:16.255498 --- ParallelTerminationStrategy: PID 4929 died... 07:01:16.277641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Terminated: ok {rc=0} 07:01:16.328131 --- ParallelTerminationStrategy: PID 4932 died... 07:01:16.349539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4932): Terminated: ok {rc=0} 07:01:16.443810 bus /gobi_0: Setting Powered False 07:01:17.541244 bus /gobi_0: Setting Powered False 07:01:18.655403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo iperf3.py ---------------------------------------------- 07:01:19.808701 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:19.820713 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:01:19.861830 tst iperf3.py: using LAC 19741 07:01:19.983786 tst iperf3.py: using RAC 106 07:01:20.105195 tst iperf3.py: using CellId 19741 07:01:20.228390 tst iperf3.py: using BVCI 19742 07:01:20.343054 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.353930 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.364429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.375188 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.385873 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.396384 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.407280 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.418054 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:20.428803 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:20.547553 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:01:20.757417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:21.072845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4934): Launched 07:01:21.345106 run iperf3-srv_10.42.42.10(pid=4935): Launched 07:01:21.461719 tst iperf3.py:8: start network... 07:01:21.670035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:22.153969 run create_hlr_db(pid=4936): Launched 07:01:22.271029 bus /gobi_6: Setting Powered False 07:01:23.332241 run create_hlr_db(pid=4936): Terminated: ok {rc=0} 07:01:23.788057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4938): Launched 07:01:24.122281 run osmo-hlr_10.42.42.2(pid=4939): Launched 07:01:24.248864 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:24.825739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4941): Launched 07:01:25.159199 run osmo-stp_10.42.42.5(pid=4942): Launched 07:01:25.289909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:25.869164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4944): Launched 07:01:25.995832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:26.279428 run patchelf(pid=4945): Launched 07:01:26.463736 run osmo-stp_10.42.42.5(pid=4942): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4942)] 07:01:26.603930 run osmo-stp_10.42.42.5(pid=4942): stdout: | (launched: 2022-12-09_07:01:25.096340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:26.745447 run osmo-stp_10.42.42.5(pid=4942): stderr: | 20221209070125292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070125292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070125293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070125293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070125293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070125294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070125294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:26.887881 run osmo-stp_10.42.42.5(pid=4942): stdout: | (launched: 2022-12-09_07:01:25.096340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:27.023907 run osmo-stp_10.42.42.5(pid=4942): stderr: | 20221209070125292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070125292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070125293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070125293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070125293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070125294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070125294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:27.185477 run patchelf(pid=4945): Terminating (SIGINT) 07:01:27.370924 run patchelf(pid=4945): Terminated: ok {rc=0} 07:01:27.504822 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4942): Process ended prematurely: osmo-stp_10.42.42.5(pid=4942) [trial-2356↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4942)] [trial-2356↪gprs:sysmo↪iperf3.py:8] 07:01:27.515270 tst iperf3.py:8: Test FAILED (7.7 sec) 07:01:27.543836 run osmo-hlr_10.42.42.2(pid=4939): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4939)] 07:01:27.593785 run osmo-hlr_10.42.42.2(pid=4939): stdout: | (launched: 2022-12-09_07:01:24.059720) 07:01:27.645675 run osmo-hlr_10.42.42.2(pid=4939): stderr: | 20221209070124262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070124262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070124262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070124262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070124262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070124262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070124275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070124286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070124286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070124286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:27.698022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4934): Terminating (SIGTERM) 07:01:27.740072 run iperf3-srv_10.42.42.10(pid=4935): Terminating (SIGTERM) 07:01:27.783119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4938): Terminating (SIGTERM) 07:01:27.825698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4941): Terminating (SIGTERM) 07:01:27.868170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4944): Terminating (SIGTERM) 07:01:27.910904 --- ParallelTerminationStrategy: PID 4934 died... 07:01:27.931276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4934): Terminated: ok {rc=0} 07:01:27.978539 --- ParallelTerminationStrategy: PID 4935 died... 07:01:27.998422 run iperf3-srv_10.42.42.10(pid=4935): Terminated {rc=256} 07:01:28.045495 --- ParallelTerminationStrategy: PID 4938 died... 07:01:28.065406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4938): Terminated: ok {rc=0} 07:01:28.112456 --- ParallelTerminationStrategy: PID 4941 died... 07:01:28.132458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4941): Terminated: ok {rc=0} 07:01:28.179449 --- ParallelTerminationStrategy: PID 4944 died... 07:01:28.199466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4944): Terminated: ok {rc=0} 07:01:28.288638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo iperf3m4.py ---------------------------------------------- 07:01:29.437897 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:29.449412 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:01:29.487006 tst iperf3m4.py: using LAC 19742 07:01:29.608680 tst iperf3m4.py: using RAC 107 07:01:29.733723 tst iperf3m4.py: using CellId 19742 07:01:29.855899 tst iperf3m4.py: using BVCI 19743 07:01:29.970886 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:29.981654 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:29.992355 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:30.003712 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:30.014878 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:30.026106 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:30.037448 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:30.048670 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:30.060299 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:30.184161 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:30.305291 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:30.427281 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:30.550367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:01:30.777945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:31.139906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4946): Launched 07:01:31.430915 run iperf3-srv_10.42.42.10(pid=4947): Launched 07:01:31.567307 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:01:31.787739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:32.118413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4948): Launched 07:01:32.404375 run iperf3-srv_10.42.42.10(pid=4949): Launched 07:01:32.522270 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:01:32.732059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:33.047307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4950): Launched 07:01:33.320294 run iperf3-srv_10.42.42.10(pid=4951): Launched 07:01:33.437239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:01:33.645872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:33.961281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4952): Launched 07:01:34.251405 run iperf3-srv_10.42.42.10(pid=4953): Launched 07:01:34.378346 tst iperf3m4.py:8: start network... 07:01:34.604486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:35.127503 run create_hlr_db(pid=4954): Launched 07:01:35.262831 bus /gobi_6: Setting Powered False 07:01:36.329384 run create_hlr_db(pid=4954): Terminated: ok {rc=0} 07:01:36.796483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4956): Launched 07:01:37.134720 run osmo-hlr_10.42.42.2(pid=4957): Launched 07:01:37.261580 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:37.840818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4959): Launched 07:01:38.177972 run osmo-stp_10.42.42.5(pid=4960): Launched 07:01:38.304322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:38.882178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4962): Launched 07:01:39.009173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:39.294218 run patchelf(pid=4963): Launched 07:01:39.481500 run osmo-stp_10.42.42.5(pid=4960): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4960)] 07:01:39.622342 run osmo-stp_10.42.42.5(pid=4960): stdout: | (launched: 2022-12-09_07:01:38.115184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:39.765172 run osmo-stp_10.42.42.5(pid=4960): stderr: | 20221209070138312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070138312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070138312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070138313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070138313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070138313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070138313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:39.908372 run osmo-stp_10.42.42.5(pid=4960): stdout: | (launched: 2022-12-09_07:01:38.115184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:40.045064 run osmo-stp_10.42.42.5(pid=4960): stderr: | 20221209070138312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070138312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070138312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070138313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070138313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070138313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070138313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:40.207297 run patchelf(pid=4963): Terminating (SIGINT) 07:01:40.393088 run patchelf(pid=4963): Terminated: ok {rc=0} 07:01:40.527155 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4960): Process ended prematurely: osmo-stp_10.42.42.5(pid=4960) [trial-2356↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4960)] [trial-2356↪gprs:sysmo↪iperf3m4.py:8] 07:01:40.537437 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:01:40.566816 run osmo-hlr_10.42.42.2(pid=4957): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4957)] 07:01:40.617736 run osmo-hlr_10.42.42.2(pid=4957): stdout: | (launched: 2022-12-09_07:01:37.071557) 07:01:40.670158 run osmo-hlr_10.42.42.2(pid=4957): stderr: | 20221209070137275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070137275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070137275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070137275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070137275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070137275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070137286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070137295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070137295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070137295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:40.723156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4946): Terminating (SIGTERM) 07:01:40.766074 run iperf3-srv_10.42.42.10(pid=4947): Terminating (SIGTERM) 07:01:40.808578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4948): Terminating (SIGTERM) 07:01:40.851103 run iperf3-srv_10.42.42.10(pid=4949): Terminating (SIGTERM) 07:01:40.893314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4950): Terminating (SIGTERM) 07:01:40.935602 run iperf3-srv_10.42.42.10(pid=4951): Terminating (SIGTERM) 07:01:40.977744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4952): Terminating (SIGTERM) 07:01:41.019980 run iperf3-srv_10.42.42.10(pid=4953): Terminating (SIGTERM) 07:01:41.062158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4956): Terminating (SIGTERM) 07:01:41.104698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4959): Terminating (SIGTERM) 07:01:41.147051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4962): Terminating (SIGTERM) 07:01:41.189608 --- ParallelTerminationStrategy: PID 4946 died... 07:01:41.209991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4946): Terminated: ok {rc=0} 07:01:41.256867 --- ParallelTerminationStrategy: PID 4947 died... 07:01:41.276579 run iperf3-srv_10.42.42.10(pid=4947): Terminated {rc=256} 07:01:41.323474 --- ParallelTerminationStrategy: PID 4948 died... 07:01:41.343296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4948): Terminated: ok {rc=0} 07:01:41.390104 --- ParallelTerminationStrategy: PID 4949 died... 07:01:41.410047 run iperf3-srv_10.42.42.10(pid=4949): Terminated {rc=256} 07:01:41.456731 --- ParallelTerminationStrategy: PID 4950 died... 07:01:41.476553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4950): Terminated: ok {rc=0} 07:01:41.523257 --- ParallelTerminationStrategy: PID 4951 died... 07:01:41.543128 run iperf3-srv_10.42.42.10(pid=4951): Terminated {rc=256} 07:01:41.589937 --- ParallelTerminationStrategy: PID 4952 died... 07:01:41.609879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4952): Terminated: ok {rc=0} 07:01:41.656464 --- ParallelTerminationStrategy: PID 4953 died... 07:01:41.676268 run iperf3-srv_10.42.42.10(pid=4953): Terminated {rc=256} 07:01:41.722863 --- ParallelTerminationStrategy: PID 4956 died... 07:01:41.742796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4956): Terminated: ok {rc=0} 07:01:41.789846 --- ParallelTerminationStrategy: PID 4959 died... 07:01:41.809746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4959): Terminated: ok {rc=0} 07:01:41.856765 --- ParallelTerminationStrategy: PID 4962 died... 07:01:41.876862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4962): Terminated: ok {rc=0} 07:01:41.965493 bus /gobi_4: Setting Powered False 07:01:43.065859 bus /gobi_4: Setting Powered False 07:01:44.182699 bus /gobi_1: Setting Powered False 07:01:45.281477 bus /gobi_1: Setting Powered False 07:01:46.404567 bus /gobi_0: Setting Powered False 07:01:47.520175 bus /gobi_0: Setting Powered False 07:01:48.638160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo ping.py ---------------------------------------------- 07:01:49.742777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:49.754603 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:01:49.792103 tst ping.py: using LAC 19743 07:01:49.923629 tst ping.py: using RAC 108 07:01:50.057628 tst ping.py: using CellId 19743 07:01:50.185743 tst ping.py: using BVCI 19744 07:01:50.307217 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.318503 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.329626 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.340679 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.351698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.362660 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.373801 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:50.384731 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:50.501949 tst ping.py:19: start network... 07:01:50.707505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:51.185282 run create_hlr_db(pid=4964): Launched 07:01:51.302931 bus /gobi_6: Setting Powered False 07:01:52.363853 run create_hlr_db(pid=4964): Terminated: ok {rc=0} 07:01:52.815240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4966): Launched 07:01:53.145195 run osmo-hlr_10.42.42.2(pid=4967): Launched 07:01:53.270910 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:53.838420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4969): Launched 07:01:54.168313 run osmo-stp_10.42.42.5(pid=4970): Launched 07:01:54.293173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:54.861167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4972): Launched 07:01:54.985922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:55.266123 run patchelf(pid=4973): Launched 07:01:55.448142 run osmo-stp_10.42.42.5(pid=4970): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4970)] 07:01:55.586729 run osmo-stp_10.42.42.5(pid=4970): stdout: | (launched: 2022-12-09_07:01:54.106174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:55.727003 run osmo-stp_10.42.42.5(pid=4970): stderr: | 20221209070154303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070154303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070154303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070154304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070154304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070154304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070154304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:55.867778 run osmo-stp_10.42.42.5(pid=4970): stdout: | (launched: 2022-12-09_07:01:54.106174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:56.003630 run osmo-stp_10.42.42.5(pid=4970): stderr: | 20221209070154303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070154303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070154303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070154304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070154304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070154304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070154304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:56.163300 run patchelf(pid=4973): Terminating (SIGINT) 07:01:56.345694 run patchelf(pid=4973): Terminated: ok {rc=0} 07:01:56.477087 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4970): Process ended prematurely: osmo-stp_10.42.42.5(pid=4970) [trial-2356↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4970)] [trial-2356↪gprs:sysmo↪ping.py:22] 07:01:56.486727 tst ping.py:22: Test FAILED (6.7 sec) 07:01:56.515094 run osmo-hlr_10.42.42.2(pid=4967): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4967)] 07:01:56.565888 run osmo-hlr_10.42.42.2(pid=4967): stdout: | (launched: 2022-12-09_07:01:53.083101) 07:01:56.618312 run osmo-hlr_10.42.42.2(pid=4967): stderr: | 20221209070153286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070153286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070153286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070153286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070153286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070153286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070153300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070153310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070153310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070153310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:56.670877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4966): Terminating (SIGTERM) 07:01:56.713219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4969): Terminating (SIGTERM) 07:01:56.755615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4972): Terminating (SIGTERM) 07:01:56.798826 --- ParallelTerminationStrategy: PID 4966 died... 07:01:56.819362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4966): Terminated: ok {rc=0} 07:01:56.866326 --- ParallelTerminationStrategy: PID 4969 died... 07:01:56.886316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4969): Terminated: ok {rc=0} 07:01:56.933208 --- ParallelTerminationStrategy: PID 4972 died... 07:01:56.952909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4972): Terminated: ok {rc=0} 07:01:57.041596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 07:01:58.130499 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.142475 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:01:58.180487 tst ping_idle_ping.py: using LAC 19744 07:01:58.301885 tst ping_idle_ping.py: using RAC 109 07:01:58.421673 tst ping_idle_ping.py: using CellId 19744 07:01:58.542620 tst ping_idle_ping.py: using BVCI 19745 07:01:58.656273 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.667255 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.678408 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.689562 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.700356 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.711386 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.722702 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:58.733949 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:58.856701 tst ping_idle_ping.py:24: start network... 07:01:59.061856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:59.539578 run create_hlr_db(pid=4974): Launched 07:01:59.655944 bus /gobi_6: Setting Powered False 07:02:00.718091 run create_hlr_db(pid=4974): Terminated: ok {rc=0} 07:02:01.192867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4976): Launched 07:02:01.542449 run osmo-hlr_10.42.42.2(pid=4977): Launched 07:02:01.797983 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:02.470720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4979): Launched 07:02:02.779746 run osmo-stp_10.42.42.5(pid=4980): Launched 07:02:02.897871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:03.430615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4982): Launched 07:02:03.547958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:03.810000 run patchelf(pid=4983): Launched 07:02:03.980436 run osmo-stp_10.42.42.5(pid=4980): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4980)] 07:02:04.110516 run osmo-stp_10.42.42.5(pid=4980): stdout: | (launched: 2022-12-09_07:02:02.721083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:04.242053 run osmo-stp_10.42.42.5(pid=4980): stderr: | 20221209070202893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070202893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070202893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070202894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070202896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070202896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070202896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:04.373317 run osmo-stp_10.42.42.5(pid=4980): stdout: | (launched: 2022-12-09_07:02:02.721083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:04.499379 run osmo-stp_10.42.42.5(pid=4980): stderr: | 20221209070202893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070202893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070202893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070202894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070202896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070202896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070202896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:04.648326 run patchelf(pid=4983): Terminating (SIGINT) 07:02:04.818912 run patchelf(pid=4983): Terminated: ok {rc=0} 07:02:04.941895 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4980): Process ended prematurely: osmo-stp_10.42.42.5(pid=4980) [trial-2356↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4980)] [trial-2356↪gprs:sysmo↪ping_idle_ping.py:27] 07:02:04.950830 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:02:04.977938 run osmo-hlr_10.42.42.2(pid=4977): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4977)] 07:02:05.026196 run osmo-hlr_10.42.42.2(pid=4977): stdout: | (launched: 2022-12-09_07:02:01.477167) 07:02:05.076680 run osmo-hlr_10.42.42.2(pid=4977): stderr: | 20221209070201788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070201788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070201788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070201789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070201789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070201789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070201807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070201819 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070201819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070201819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:05.127393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4976): Terminating (SIGTERM) 07:02:05.167678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4979): Terminating (SIGTERM) 07:02:05.208003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4982): Terminating (SIGTERM) 07:02:05.248786 --- ParallelTerminationStrategy: PID 4976 died... 07:02:05.268076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4976): Terminated: ok {rc=0} 07:02:05.313387 --- ParallelTerminationStrategy: PID 4979 died... 07:02:05.332262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4979): Terminated: ok {rc=0} 07:02:05.377309 --- ParallelTerminationStrategy: PID 4982 died... 07:02:05.396198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4982): Terminated: ok {rc=0} 07:02:05.483477 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 07:02:06.772650 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:02:06.778290 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:02:06.800245 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:02:06.839547 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:02:06.927177 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:02:06.948166 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:02:06.987227 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:02:07.580333 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:02:07.630859 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:07.641810 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:02:07.679141 tst cs_paging_gprs_active.py: using LAC 19745 07:02:07.802354 tst cs_paging_gprs_active.py: using RAC 110 07:02:07.925706 tst cs_paging_gprs_active.py: using CellId 19745 07:02:08.047318 tst cs_paging_gprs_active.py: using BVCI 19746 07:02:08.162485 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.173597 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.184177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.195119 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.206003 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.216822 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.227964 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.238863 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:08.249960 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:08.373726 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:08.495726 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:02:08.706356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:09.022788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4988): Launched 07:02:09.296594 run iperf3-srv_10.42.42.10(pid=4989): Launched 07:02:09.413869 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:02:09.622675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:09.938399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4990): Launched 07:02:10.213184 run iperf3-srv_10.42.42.10(pid=4991): Launched 07:02:10.330898 tst cs_paging_gprs_active.py:38: start network... 07:02:10.540013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:11.024939 run create_hlr_db(pid=4992): Launched 07:02:11.143927 bus /gobi_6: Setting Powered False 07:02:12.205571 run create_hlr_db(pid=4992): Terminated: ok {rc=0} 07:02:12.663421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4994): Launched 07:02:12.999249 run osmo-hlr_10.42.42.2(pid=4995): Launched 07:02:13.127087 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:13.701295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4997): Launched 07:02:14.038641 run osmo-stp_10.42.42.5(pid=4998): Launched 07:02:14.166946 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:14.745049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5000): Launched 07:02:14.872273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:15.156266 run patchelf(pid=5001): Launched 07:02:15.341558 run osmo-stp_10.42.42.5(pid=4998): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4998)] 07:02:15.482397 run osmo-stp_10.42.42.5(pid=4998): stdout: | (launched: 2022-12-09_07:02:13.975442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:15.624899 run osmo-stp_10.42.42.5(pid=4998): stderr: | 20221209070214172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070214172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070214172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070214172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070214173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070214173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070214173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:15.767720 run osmo-stp_10.42.42.5(pid=4998): stdout: | (launched: 2022-12-09_07:02:13.975442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:15.909291 run osmo-stp_10.42.42.5(pid=4998): stderr: | 20221209070214172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070214172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070214172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070214172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070214173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070214173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070214173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:16.075013 run patchelf(pid=5001): Terminating (SIGINT) 07:02:16.257705 run patchelf(pid=5001): Terminated: ok {rc=0} 07:02:16.388803 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4998): Process ended prematurely: osmo-stp_10.42.42.5(pid=4998) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4998)] [trial-2356↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:02:16.399771 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:02:16.430995 run osmo-hlr_10.42.42.2(pid=4995): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4995)] 07:02:16.483445 run osmo-hlr_10.42.42.2(pid=4995): stdout: | (launched: 2022-12-09_07:02:12.936630) 07:02:16.537536 run osmo-hlr_10.42.42.2(pid=4995): stderr: | 20221209070213139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070213139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070213139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070213139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070213139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070213139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070213152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070213162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070213162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070213162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:16.591099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4988): Terminating (SIGTERM) 07:02:16.634022 run iperf3-srv_10.42.42.10(pid=4989): Terminating (SIGTERM) 07:02:16.678577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4990): Terminating (SIGTERM) 07:02:16.723468 run iperf3-srv_10.42.42.10(pid=4991): Terminating (SIGTERM) 07:02:16.766802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4994): Terminating (SIGTERM) 07:02:16.810590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4997): Terminating (SIGTERM) 07:02:16.855409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5000): Terminating (SIGTERM) 07:02:16.901737 --- ParallelTerminationStrategy: PID 4988 died... 07:02:16.922162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4988): Terminated: ok {rc=0} 07:02:16.972008 --- ParallelTerminationStrategy: PID 4989 died... 07:02:16.991849 run iperf3-srv_10.42.42.10(pid=4989): Terminated {rc=256} 07:02:17.040109 --- ParallelTerminationStrategy: PID 4990 died... 07:02:17.060292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4990): Terminated: ok {rc=0} 07:02:17.109486 --- ParallelTerminationStrategy: PID 4991 died... 07:02:17.129601 run iperf3-srv_10.42.42.10(pid=4991): Terminated {rc=256} 07:02:17.177492 --- ParallelTerminationStrategy: PID 4994 died... 07:02:17.197121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4994): Terminated: ok {rc=0} 07:02:17.245138 --- ParallelTerminationStrategy: PID 4997 died... 07:02:17.264151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4997): Terminated: ok {rc=0} 07:02:17.310417 --- ParallelTerminationStrategy: PID 5000 died... 07:02:17.329368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5000): Terminated: ok {rc=0} 07:02:17.416164 bus /gobi_0: Setting Powered False 07:02:18.514286 bus /gobi_0: Setting Powered False 07:02:19.628617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:02:20.781371 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:20.793567 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:02:20.836508 tst iperf3.py: using LAC 19746 07:02:20.967750 tst iperf3.py: using RAC 111 07:02:21.096821 tst iperf3.py: using CellId 19746 07:02:21.225349 tst iperf3.py: using BVCI 19747 07:02:21.346717 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.358148 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.369552 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.380800 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.391979 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.403139 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.414548 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.425813 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:21.437208 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:21.558964 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:02:21.770094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:22.086347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5002): Launched 07:02:22.359401 run iperf3-srv_10.42.42.10(pid=5003): Launched 07:02:22.476150 tst iperf3.py:8: start network... 07:02:22.684782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:23.167252 run create_hlr_db(pid=5004): Launched 07:02:23.285914 bus /gobi_6: Setting Powered False 07:02:24.348137 run create_hlr_db(pid=5004): Terminated: ok {rc=0} 07:02:24.783061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5006): Launched 07:02:25.096642 run osmo-hlr_10.42.42.2(pid=5007): Launched 07:02:25.215344 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:25.748473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5009): Launched 07:02:26.062024 run osmo-stp_10.42.42.5(pid=5010): Launched 07:02:26.191323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:26.772206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5012): Launched 07:02:26.899578 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:27.184229 run patchelf(pid=5013): Launched 07:02:27.368663 run osmo-stp_10.42.42.5(pid=5010): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5010)] 07:02:27.508797 run osmo-stp_10.42.42.5(pid=5010): stdout: | (launched: 2022-12-09_07:02:26.002660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:27.650728 run osmo-stp_10.42.42.5(pid=5010): stderr: | 20221209070226193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070226193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070226194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070226194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070226195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070226195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070226195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:27.792916 run osmo-stp_10.42.42.5(pid=5010): stdout: | (launched: 2022-12-09_07:02:26.002660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:27.929183 run osmo-stp_10.42.42.5(pid=5010): stderr: | 20221209070226193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070226193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070226194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070226194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070226195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070226195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070226195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:28.090554 run patchelf(pid=5013): Terminating (SIGINT) 07:02:28.276431 run patchelf(pid=5013): Terminated: ok {rc=0} 07:02:28.410080 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5010): Process ended prematurely: osmo-stp_10.42.42.5(pid=5010) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5010)] [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 07:02:28.420381 tst iperf3.py:8: Test FAILED (7.7 sec) 07:02:28.449313 run osmo-hlr_10.42.42.2(pid=5007): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5007)] 07:02:28.499498 run osmo-hlr_10.42.42.2(pid=5007): stdout: | (launched: 2022-12-09_07:02:25.037361) 07:02:28.551369 run osmo-hlr_10.42.42.2(pid=5007): stderr: | 20221209070225217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070225217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070225217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070225217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070225217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070225217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070225241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070225250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070225250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070225250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:28.603817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5002): Terminating (SIGTERM) 07:02:28.645741 run iperf3-srv_10.42.42.10(pid=5003): Terminating (SIGTERM) 07:02:28.688883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5006): Terminating (SIGTERM) 07:02:28.731096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5009): Terminating (SIGTERM) 07:02:28.773022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5012): Terminating (SIGTERM) 07:02:28.815466 --- ParallelTerminationStrategy: PID 5002 died... 07:02:28.835554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5002): Terminated: ok {rc=0} 07:02:28.883072 --- ParallelTerminationStrategy: PID 5003 died... 07:02:28.902830 run iperf3-srv_10.42.42.10(pid=5003): Terminated {rc=256} 07:02:28.948700 --- ParallelTerminationStrategy: PID 5006 died... 07:02:28.968366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5006): Terminated: ok {rc=0} 07:02:29.014705 --- ParallelTerminationStrategy: PID 5009 died... 07:02:29.034532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5009): Terminated: ok {rc=0} 07:02:29.081026 --- ParallelTerminationStrategy: PID 5012 died... 07:02:29.100747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5012): Terminated: ok {rc=0} 07:02:29.188990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:02:30.335418 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.347131 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:02:30.385656 tst iperf3m4.py: using LAC 19747 07:02:30.509763 tst iperf3m4.py: using RAC 112 07:02:30.634200 tst iperf3m4.py: using CellId 19747 07:02:30.757432 tst iperf3m4.py: using BVCI 19748 07:02:30.891355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.903530 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.916081 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.928908 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.941268 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.953267 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.965475 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.977464 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:30.989747 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:31.127932 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:31.249059 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:31.371777 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:31.517045 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:02:31.784664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:32.164422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5014): Launched 07:02:32.482387 run iperf3-srv_10.42.42.10(pid=5015): Launched 07:02:32.600340 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:02:32.810603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:33.126665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5016): Launched 07:02:33.400783 run iperf3-srv_10.42.42.10(pid=5017): Launched 07:02:33.518253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:02:33.726289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:34.040511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5018): Launched 07:02:34.314327 run iperf3-srv_10.42.42.10(pid=5019): Launched 07:02:34.431290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:02:34.639984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:34.955710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5020): Launched 07:02:35.229372 run iperf3-srv_10.42.42.10(pid=5021): Launched 07:02:35.345673 tst iperf3m4.py:8: start network... 07:02:35.553373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:36.059945 run create_hlr_db(pid=5025): Launched 07:02:36.195295 bus /gobi_6: Setting Powered False 07:02:37.260819 run create_hlr_db(pid=5025): Terminated: ok {rc=0} 07:02:37.705255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5027): Launched 07:02:38.019352 run osmo-hlr_10.42.42.2(pid=5028): Launched 07:02:38.137856 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:38.689576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5030): Launched 07:02:39.002481 run osmo-stp_10.42.42.5(pid=5031): Launched 07:02:39.120918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:39.658461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5033): Launched 07:02:39.777248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:40.043265 run patchelf(pid=5034): Launched 07:02:40.216090 run osmo-stp_10.42.42.5(pid=5031): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5031)] 07:02:40.347788 run osmo-stp_10.42.42.5(pid=5031): stdout: | (launched: 2022-12-09_07:02:38.942937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:40.480621 run osmo-stp_10.42.42.5(pid=5031): stderr: | 20221209070239117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070239117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070239117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070239118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070239118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070239118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070239118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:40.613380 run osmo-stp_10.42.42.5(pid=5031): stdout: | (launched: 2022-12-09_07:02:38.942937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:40.740390 run osmo-stp_10.42.42.5(pid=5031): stderr: | 20221209070239117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070239117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070239117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070239118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070239118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070239118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070239118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:40.891593 run patchelf(pid=5034): Terminating (SIGINT) 07:02:41.065197 run patchelf(pid=5034): Terminated: ok {rc=0} 07:02:41.189904 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5031): Process ended prematurely: osmo-stp_10.42.42.5(pid=5031) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5031)] [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 07:02:41.199504 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:02:41.227374 run osmo-hlr_10.42.42.2(pid=5028): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5028)] 07:02:41.275551 run osmo-hlr_10.42.42.2(pid=5028): stdout: | (launched: 2022-12-09_07:02:37.959959) 07:02:41.325454 run osmo-hlr_10.42.42.2(pid=5028): stderr: | 20221209070238139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070238139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070238139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070238139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070238139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070238139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070238151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070238159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070238160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070238160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:41.376041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5014): Terminating (SIGTERM) 07:02:41.415659 run iperf3-srv_10.42.42.10(pid=5015): Terminating (SIGTERM) 07:02:41.455901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5016): Terminating (SIGTERM) 07:02:41.496348 run iperf3-srv_10.42.42.10(pid=5017): Terminating (SIGTERM) 07:02:41.536549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5018): Terminating (SIGTERM) 07:02:41.576851 run iperf3-srv_10.42.42.10(pid=5019): Terminating (SIGTERM) 07:02:41.617154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5020): Terminating (SIGTERM) 07:02:41.657409 run iperf3-srv_10.42.42.10(pid=5021): Terminating (SIGTERM) 07:02:41.697558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5027): Terminating (SIGTERM) 07:02:41.737745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5030): Terminating (SIGTERM) 07:02:41.778083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5033): Terminating (SIGTERM) 07:02:41.818557 --- ParallelTerminationStrategy: PID 5014 died... 07:02:41.837761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5014): Terminated: ok {rc=0} 07:02:41.882938 --- ParallelTerminationStrategy: PID 5015 died... 07:02:41.901897 run iperf3-srv_10.42.42.10(pid=5015): Terminated {rc=256} 07:02:41.946943 --- ParallelTerminationStrategy: PID 5016 died... 07:02:41.965739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5016): Terminated: ok {rc=0} 07:02:42.011094 --- ParallelTerminationStrategy: PID 5017 died... 07:02:42.029858 run iperf3-srv_10.42.42.10(pid=5017): Terminated {rc=256} 07:02:42.074555 --- ParallelTerminationStrategy: PID 5018 died... 07:02:42.093370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5018): Terminated: ok {rc=0} 07:02:42.138304 --- ParallelTerminationStrategy: PID 5019 died... 07:02:42.157240 run iperf3-srv_10.42.42.10(pid=5019): Terminated {rc=256} 07:02:42.202054 --- ParallelTerminationStrategy: PID 5020 died... 07:02:42.220824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5020): Terminated: ok {rc=0} 07:02:42.265775 --- ParallelTerminationStrategy: PID 5021 died... 07:02:42.284397 run iperf3-srv_10.42.42.10(pid=5021): Terminated {rc=256} 07:02:42.329335 --- ParallelTerminationStrategy: PID 5027 died... 07:02:42.348081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5027): Terminated: ok {rc=0} 07:02:42.392835 --- ParallelTerminationStrategy: PID 5030 died... 07:02:42.411961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5030): Terminated: ok {rc=0} 07:02:42.456202 --- ParallelTerminationStrategy: PID 5033 died... 07:02:42.474911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5033): Terminated: ok {rc=0} 07:02:42.561159 bus /gobi_4: Setting Powered False 07:02:43.661122 bus /gobi_4: Setting Powered False 07:02:44.777590 bus /gobi_1: Setting Powered False 07:02:45.910692 bus /gobi_1: Setting Powered False 07:02:47.024570 bus /gobi_0: Setting Powered False 07:02:48.139393 bus /gobi_0: Setting Powered False 07:02:49.255544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 07:02:50.356125 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.367648 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:02:50.404666 tst ping.py: using LAC 19748 07:02:50.524159 tst ping.py: using RAC 113 07:02:50.645705 tst ping.py: using CellId 19748 07:02:50.765768 tst ping.py: using BVCI 19749 07:02:50.876473 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.887372 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.898190 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.909212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.920110 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.931247 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.942304 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:50.953363 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:51.073460 tst ping.py:19: start network... 07:02:51.295631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:51.807985 run create_hlr_db(pid=5035): Launched 07:02:51.943625 bus /gobi_6: Setting Powered False 07:02:53.004574 run create_hlr_db(pid=5035): Terminated: ok {rc=0} 07:02:53.465441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5037): Launched 07:02:53.795651 run osmo-hlr_10.42.42.2(pid=5038): Launched 07:02:53.920920 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:54.492188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5040): Launched 07:02:54.822031 run osmo-stp_10.42.42.5(pid=5041): Launched 07:02:54.947085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:55.513948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5043): Launched 07:02:55.638760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:55.918670 run patchelf(pid=5044): Launched 07:02:56.100406 run osmo-stp_10.42.42.5(pid=5041): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5041)] 07:02:56.238474 run osmo-stp_10.42.42.5(pid=5041): stdout: | (launched: 2022-12-09_07:02:54.759492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:56.377922 run osmo-stp_10.42.42.5(pid=5041): stderr: | 20221209070254954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070254954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070254954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070254955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070254957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070254957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070254957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:56.517920 run osmo-stp_10.42.42.5(pid=5041): stdout: | (launched: 2022-12-09_07:02:54.759492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:56.651853 run osmo-stp_10.42.42.5(pid=5041): stderr: | 20221209070254954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070254954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070254954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070254955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070254957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070254957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070254957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:56.811351 run patchelf(pid=5044): Terminating (SIGINT) 07:02:56.993354 run patchelf(pid=5044): Terminated: ok {rc=0} 07:02:57.124358 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5041): Process ended prematurely: osmo-stp_10.42.42.5(pid=5041) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5041)] [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 07:02:57.134084 tst ping.py:22: Test FAILED (6.8 sec) 07:02:57.162398 run osmo-hlr_10.42.42.2(pid=5038): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5038)] 07:02:57.212480 run osmo-hlr_10.42.42.2(pid=5038): stdout: | (launched: 2022-12-09_07:02:53.733524) 07:02:57.264320 run osmo-hlr_10.42.42.2(pid=5038): stderr: | 20221209070253936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070253936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070253936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070253936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070253936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070253936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070253949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070253958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070253958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070253958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:57.316461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5037): Terminating (SIGTERM) 07:02:57.360116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5040): Terminating (SIGTERM) 07:02:57.402232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5043): Terminating (SIGTERM) 07:02:57.444512 --- ParallelTerminationStrategy: PID 5037 died... 07:02:57.464667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5037): Terminated: ok {rc=0} 07:02:57.511558 --- ParallelTerminationStrategy: PID 5040 died... 07:02:57.531470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5040): Terminated: ok {rc=0} 07:02:57.578185 --- ParallelTerminationStrategy: PID 5043 died... 07:02:57.598332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5043): Terminated: ok {rc=0} 07:02:57.685794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:02:58.774991 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:58.787007 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:02:58.825439 tst ping_idle_ping.py: using LAC 19749 07:02:58.948569 tst ping_idle_ping.py: using RAC 114 07:02:59.070130 tst ping_idle_ping.py: using CellId 19749 07:02:59.199531 tst ping_idle_ping.py: using BVCI 19750 07:02:59.321432 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.333002 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.344517 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.355964 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.367318 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.378549 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.390046 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:59.401341 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:59.526377 tst ping_idle_ping.py:24: start network... 07:02:59.748803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:00.262653 run create_hlr_db(pid=5045): Launched 07:03:00.397426 bus /gobi_6: Setting Powered False 07:03:01.464249 run create_hlr_db(pid=5045): Terminated: ok {rc=0} 07:03:01.906998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5048): Launched 07:03:02.233259 run osmo-hlr_10.42.42.2(pid=5049): Launched 07:03:02.352202 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:02.883815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5051): Launched 07:03:03.191544 run osmo-stp_10.42.42.5(pid=5052): Launched 07:03:03.308653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:03.844858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5054): Launched 07:03:03.961858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:04.222770 run patchelf(pid=5055): Launched 07:03:04.393562 run osmo-stp_10.42.42.5(pid=5052): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5052)] 07:03:04.523041 run osmo-stp_10.42.42.5(pid=5052): stdout: | (launched: 2022-12-09_07:03:03.133133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:04.654270 run osmo-stp_10.42.42.5(pid=5052): stderr: | 20221209070303307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070303307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070303308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070303308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070303308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070303309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070303309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:04.785100 run osmo-stp_10.42.42.5(pid=5052): stdout: | (launched: 2022-12-09_07:03:03.133133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:04.910776 run osmo-stp_10.42.42.5(pid=5052): stderr: | 20221209070303307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070303307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070303308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070303308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070303308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070303309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070303309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:05.058887 run patchelf(pid=5055): Terminating (SIGINT) 07:03:05.228785 run patchelf(pid=5055): Terminated: ok {rc=0} 07:03:05.351487 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5052): Process ended prematurely: osmo-stp_10.42.42.5(pid=5052) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5052)] [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 07:03:05.360545 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:03:05.387488 run osmo-hlr_10.42.42.2(pid=5049): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5049)] 07:03:05.435661 run osmo-hlr_10.42.42.2(pid=5049): stdout: | (launched: 2022-12-09_07:03:02.173534) 07:03:05.485256 run osmo-hlr_10.42.42.2(pid=5049): stderr: | 20221209070302354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070302354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070302354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070302354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070302354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070302354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070302411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070302421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070302421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070302421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:05.535623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5048): Terminating (SIGTERM) 07:03:05.575731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5051): Terminating (SIGTERM) 07:03:05.615749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5054): Terminating (SIGTERM) 07:03:05.655943 --- ParallelTerminationStrategy: PID 5048 died... 07:03:05.675011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5048): Terminated: ok {rc=0} 07:03:05.719497 --- ParallelTerminationStrategy: PID 5051 died... 07:03:05.738008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5051): Terminated: ok {rc=0} 07:03:05.782162 --- ParallelTerminationStrategy: PID 5054 died... 07:03:05.800677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5054): Terminated: ok {rc=0} 07:03:05.884343 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:03:07.174427 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:03:07.180220 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:03:07.201571 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:03:07.240938 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:03:07.329204 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:03:07.350184 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:03:07.389357 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:03:07.984070 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:03:08.034394 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.045487 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:03:08.102246 tst cs_paging_gprs_active.py: using LAC 19750 07:03:08.225837 tst cs_paging_gprs_active.py: using RAC 115 07:03:08.347686 tst cs_paging_gprs_active.py: using CellId 19750 07:03:08.471332 tst cs_paging_gprs_active.py: using BVCI 19751 07:03:08.586386 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.597565 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.608326 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.619386 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.630372 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.641450 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.652472 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.663820 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:08.675042 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:08.798435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:08.921579 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:03:09.149340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:09.488498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5059): Launched 07:03:09.781292 run iperf3-srv_10.42.42.10(pid=5060): Launched 07:03:09.906998 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:03:10.132256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:10.469609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5061): Launched 07:03:10.761462 run iperf3-srv_10.42.42.10(pid=5062): Launched 07:03:10.886723 tst cs_paging_gprs_active.py:38: start network... 07:03:11.111426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:11.630801 run create_hlr_db(pid=5063): Launched 07:03:11.767417 bus /gobi_6: Setting Powered False 07:03:12.833625 run create_hlr_db(pid=5063): Terminated: ok {rc=0} 07:03:13.300309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5065): Launched 07:03:13.636134 run osmo-hlr_10.42.42.2(pid=5066): Launched 07:03:13.766176 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:14.343445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5068): Launched 07:03:14.680023 run osmo-stp_10.42.42.5(pid=5069): Launched 07:03:14.806893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:15.385925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5071): Launched 07:03:15.515001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:15.799411 run patchelf(pid=5072): Launched 07:03:16.002357 run osmo-stp_10.42.42.5(pid=5069): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5069)] 07:03:16.145212 run osmo-stp_10.42.42.5(pid=5069): stdout: | (launched: 2022-12-09_07:03:14.616684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:16.289664 run osmo-stp_10.42.42.5(pid=5069): stderr: | 20221209070314815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070314815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070314815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070314815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070314816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070314816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070314816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:16.434177 run osmo-stp_10.42.42.5(pid=5069): stdout: | (launched: 2022-12-09_07:03:14.616684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:16.572785 run osmo-stp_10.42.42.5(pid=5069): stderr: | 20221209070314815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070314815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070314815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070314815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070314816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070314816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070314816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:16.738106 run patchelf(pid=5072): Terminating (SIGINT) 07:03:16.927375 run patchelf(pid=5072): Terminated: ok {rc=0} 07:03:17.063289 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5069): Process ended prematurely: osmo-stp_10.42.42.5(pid=5069) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5069)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:03:17.074279 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 07:03:17.103629 run osmo-hlr_10.42.42.2(pid=5066): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5066)] 07:03:17.154904 run osmo-hlr_10.42.42.2(pid=5066): stdout: | (launched: 2022-12-09_07:03:13.573401) 07:03:17.207747 run osmo-hlr_10.42.42.2(pid=5066): stderr: | 20221209070313775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070313775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070313775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070313775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070313775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070313775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070313787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070313796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070313796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070313796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:17.260514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5059): Terminating (SIGTERM) 07:03:17.302709 run iperf3-srv_10.42.42.10(pid=5060): Terminating (SIGTERM) 07:03:17.344739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5061): Terminating (SIGTERM) 07:03:17.386738 run iperf3-srv_10.42.42.10(pid=5062): Terminating (SIGTERM) 07:03:17.428665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5065): Terminating (SIGTERM) 07:03:17.470629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5068): Terminating (SIGTERM) 07:03:17.512448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5071): Terminating (SIGTERM) 07:03:17.554416 --- ParallelTerminationStrategy: PID 5059 died... 07:03:17.574515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5059): Terminated: ok {rc=0} 07:03:17.620925 --- ParallelTerminationStrategy: PID 5060 died... 07:03:17.640662 run iperf3-srv_10.42.42.10(pid=5060): Terminated {rc=256} 07:03:17.686706 --- ParallelTerminationStrategy: PID 5061 died... 07:03:17.706469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5061): Terminated: ok {rc=0} 07:03:17.752424 --- ParallelTerminationStrategy: PID 5062 died... 07:03:17.772055 run iperf3-srv_10.42.42.10(pid=5062): Terminated {rc=256} 07:03:17.818465 --- ParallelTerminationStrategy: PID 5065 died... 07:03:17.838206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5065): Terminated: ok {rc=0} 07:03:17.884456 --- ParallelTerminationStrategy: PID 5068 died... 07:03:17.904029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5068): Terminated: ok {rc=0} 07:03:17.949953 --- ParallelTerminationStrategy: PID 5071 died... 07:03:17.969608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5071): Terminated: ok {rc=0} 07:03:18.058336 bus /gobi_0: Setting Powered False 07:03:19.159007 bus /gobi_0: Setting Powered False 07:03:20.275681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:03:21.428638 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:21.440939 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:03:21.506597 tst iperf3.py: using LAC 19751 07:03:21.638126 tst iperf3.py: using RAC 116 07:03:21.768787 tst iperf3.py: using CellId 19751 07:03:21.899356 tst iperf3.py: using BVCI 19752 07:03:22.022432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.033993 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.045316 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.056605 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.067866 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.079074 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.090594 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.101735 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:22.113179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:22.235113 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:03:22.462358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:22.801418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5073): Launched 07:03:23.095058 run iperf3-srv_10.42.42.10(pid=5074): Launched 07:03:23.220356 tst iperf3.py:8: start network... 07:03:23.446428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:23.966919 run create_hlr_db(pid=5075): Launched 07:03:24.102121 bus /gobi_6: Setting Powered False 07:03:25.167659 run create_hlr_db(pid=5075): Terminated: ok {rc=0} 07:03:25.614109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5077): Launched 07:03:25.927912 run osmo-hlr_10.42.42.2(pid=5078): Launched 07:03:26.047095 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:26.586974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5080): Launched 07:03:26.900081 run osmo-stp_10.42.42.5(pid=5081): Launched 07:03:27.018568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:27.556774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5083): Launched 07:03:27.676009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:27.942025 run patchelf(pid=5084): Launched 07:03:28.114870 run osmo-stp_10.42.42.5(pid=5081): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5081)] 07:03:28.246410 run osmo-stp_10.42.42.5(pid=5081): stdout: | (launched: 2022-12-09_07:03:26.840752) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:28.379881 run osmo-stp_10.42.42.5(pid=5081): stderr: | 20221209070327015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070327015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070327015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070327016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070327016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070327016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070327016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:28.513281 run osmo-stp_10.42.42.5(pid=5081): stdout: | (launched: 2022-12-09_07:03:26.840752) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:28.641154 run osmo-stp_10.42.42.5(pid=5081): stderr: | 20221209070327015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070327015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070327015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070327016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070327016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070327016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070327016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:28.793505 run patchelf(pid=5084): Terminating (SIGINT) 07:03:28.967323 run patchelf(pid=5084): Terminated: ok {rc=0} 07:03:29.092587 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5081): Process ended prematurely: osmo-stp_10.42.42.5(pid=5081) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5081)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 07:03:29.102410 tst iperf3.py:8: Test FAILED (7.7 sec) 07:03:29.130100 run osmo-hlr_10.42.42.2(pid=5078): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5078)] 07:03:29.178731 run osmo-hlr_10.42.42.2(pid=5078): stdout: | (launched: 2022-12-09_07:03:25.869119) 07:03:29.229367 run osmo-hlr_10.42.42.2(pid=5078): stderr: | 20221209070326047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070326047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070326047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070326047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070326047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070326047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070326060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070326071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070326072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070326072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:29.279582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5073): Terminating (SIGTERM) 07:03:29.319604 run iperf3-srv_10.42.42.10(pid=5074): Terminating (SIGTERM) 07:03:29.359721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5077): Terminating (SIGTERM) 07:03:29.399772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5080): Terminating (SIGTERM) 07:03:29.439726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5083): Terminating (SIGTERM) 07:03:29.479706 --- ParallelTerminationStrategy: PID 5073 died... 07:03:29.499032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5073): Terminated: ok {rc=0} 07:03:29.543667 --- ParallelTerminationStrategy: PID 5074 died... 07:03:29.562391 run iperf3-srv_10.42.42.10(pid=5074): Terminated {rc=256} 07:03:29.606807 --- ParallelTerminationStrategy: PID 5077 died... 07:03:29.625478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5077): Terminated: ok {rc=0} 07:03:29.670243 --- ParallelTerminationStrategy: PID 5080 died... 07:03:29.688902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5080): Terminated: ok {rc=0} 07:03:29.733473 --- ParallelTerminationStrategy: PID 5083 died... 07:03:29.752257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5083): Terminated: ok {rc=0} 07:03:29.840027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:03:31.006639 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.019833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:03:31.080867 tst iperf3m4.py: using LAC 19752 07:03:31.206399 tst iperf3m4.py: using RAC 117 07:03:31.374787 tst iperf3m4.py: using CellId 19752 07:03:31.508324 tst iperf3m4.py: using BVCI 19753 07:03:31.655970 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.669745 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.683119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.696127 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.708434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.721141 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.736716 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.749570 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:31.762202 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:31.889774 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:32.019473 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:32.149434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:32.277441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:03:32.505743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:32.844869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5085): Launched 07:03:33.137468 run iperf3-srv_10.42.42.10(pid=5086): Launched 07:03:33.263848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:03:33.489340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:33.826725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5087): Launched 07:03:34.118951 run iperf3-srv_10.42.42.10(pid=5088): Launched 07:03:34.243802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:03:34.469838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:34.808463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5089): Launched 07:03:35.102856 run iperf3-srv_10.42.42.10(pid=5090): Launched 07:03:35.227997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:03:35.453938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:35.792369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5091): Launched 07:03:36.066966 run iperf3-srv_10.42.42.10(pid=5092): Launched 07:03:36.183838 tst iperf3m4.py:8: start network... 07:03:36.393413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:36.880312 run create_hlr_db(pid=5093): Launched 07:03:37.000256 bus /gobi_6: Setting Powered False 07:03:38.062740 run create_hlr_db(pid=5093): Terminated: ok {rc=0} 07:03:38.497961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5095): Launched 07:03:38.811980 run osmo-hlr_10.42.42.2(pid=5096): Launched 07:03:38.931314 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:39.469343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5098): Launched 07:03:39.782036 run osmo-stp_10.42.42.5(pid=5099): Launched 07:03:39.900903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:40.440015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5101): Launched 07:03:40.558894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:40.825077 run patchelf(pid=5102): Launched 07:03:40.998640 run osmo-stp_10.42.42.5(pid=5099): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5099)] 07:03:41.129884 run osmo-stp_10.42.42.5(pid=5099): stdout: | (launched: 2022-12-09_07:03:39.722557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:41.262645 run osmo-stp_10.42.42.5(pid=5099): stderr: | 20221209070339895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070339895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070339895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070339896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070339898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070339898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070339898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:41.395409 run osmo-stp_10.42.42.5(pid=5099): stdout: | (launched: 2022-12-09_07:03:39.722557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:41.523060 run osmo-stp_10.42.42.5(pid=5099): stderr: | 20221209070339895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070339895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070339895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070339896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070339898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070339898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070339898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:41.673813 run patchelf(pid=5102): Terminating (SIGINT) 07:03:41.847006 run patchelf(pid=5102): Terminated: ok {rc=0} 07:03:41.972338 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5099): Process ended prematurely: osmo-stp_10.42.42.5(pid=5099) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5099)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:03:41.982199 tst iperf3m4.py:8: Test FAILED (11.0 sec) 07:03:42.010185 run osmo-hlr_10.42.42.2(pid=5096): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5096)] 07:03:42.059360 run osmo-hlr_10.42.42.2(pid=5096): stdout: | (launched: 2022-12-09_07:03:38.752155) 07:03:42.109754 run osmo-hlr_10.42.42.2(pid=5096): stderr: | 20221209070338932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070338932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070338932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070338932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070338932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070338932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070338945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070338953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070338953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070338953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:42.160788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5085): Terminating (SIGTERM) 07:03:42.201263 run iperf3-srv_10.42.42.10(pid=5086): Terminating (SIGTERM) 07:03:42.241742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5087): Terminating (SIGTERM) 07:03:42.282125 run iperf3-srv_10.42.42.10(pid=5088): Terminating (SIGTERM) 07:03:42.322242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5089): Terminating (SIGTERM) 07:03:42.362932 run iperf3-srv_10.42.42.10(pid=5090): Terminating (SIGTERM) 07:03:42.403240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5091): Terminating (SIGTERM) 07:03:42.443530 run iperf3-srv_10.42.42.10(pid=5092): Terminating (SIGTERM) 07:03:42.483792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5095): Terminating (SIGTERM) 07:03:42.523976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5098): Terminating (SIGTERM) 07:03:42.563992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5101): Terminating (SIGTERM) 07:03:42.604821 --- ParallelTerminationStrategy: PID 5085 died... 07:03:42.624732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5085): Terminated: ok {rc=0} 07:03:42.669671 --- ParallelTerminationStrategy: PID 5086 died... 07:03:42.688540 run iperf3-srv_10.42.42.10(pid=5086): Terminated {rc=256} 07:03:42.733669 --- ParallelTerminationStrategy: PID 5087 died... 07:03:42.752335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5087): Terminated: ok {rc=0} 07:03:42.797452 --- ParallelTerminationStrategy: PID 5088 died... 07:03:42.816504 run iperf3-srv_10.42.42.10(pid=5088): Terminated {rc=256} 07:03:42.862312 --- ParallelTerminationStrategy: PID 5089 died... 07:03:42.881391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5089): Terminated: ok {rc=0} 07:03:42.926486 --- ParallelTerminationStrategy: PID 5090 died... 07:03:42.945450 run iperf3-srv_10.42.42.10(pid=5090): Terminated {rc=256} 07:03:42.990359 --- ParallelTerminationStrategy: PID 5091 died... 07:03:43.009455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5091): Terminated: ok {rc=0} 07:03:43.054778 --- ParallelTerminationStrategy: PID 5092 died... 07:03:43.073789 run iperf3-srv_10.42.42.10(pid=5092): Terminated {rc=256} 07:03:43.118824 --- ParallelTerminationStrategy: PID 5095 died... 07:03:43.137891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5095): Terminated: ok {rc=0} 07:03:43.183156 --- ParallelTerminationStrategy: PID 5098 died... 07:03:43.202329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5098): Terminated: ok {rc=0} 07:03:43.247612 --- ParallelTerminationStrategy: PID 5101 died... 07:03:43.266788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5101): Terminated: ok {rc=0} 07:03:43.355399 bus /gobi_4: Setting Powered False 07:03:44.456917 bus /gobi_4: Setting Powered False 07:03:45.575213 bus /gobi_1: Setting Powered False 07:03:46.685613 bus /gobi_1: Setting Powered False 07:03:47.822455 bus /gobi_0: Setting Powered False 07:03:48.923702 bus /gobi_0: Setting Powered False 07:03:50.041430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:03:51.145335 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.157696 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:03:51.217535 tst ping.py: using LAC 19753 07:03:51.348077 tst ping.py: using RAC 118 07:03:51.477062 tst ping.py: using CellId 19753 07:03:51.608368 tst ping.py: using BVCI 19754 07:03:51.729934 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.741498 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.752765 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.764207 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.775441 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.786741 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.798297 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:51.809723 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:51.929197 tst ping.py:19: start network... 07:03:52.150866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:52.662769 run create_hlr_db(pid=5103): Launched 07:03:52.796382 bus /gobi_6: Setting Powered False 07:03:53.861820 run create_hlr_db(pid=5103): Terminated: ok {rc=0} 07:03:54.320520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5105): Launched 07:03:54.650968 run osmo-hlr_10.42.42.2(pid=5106): Launched 07:03:54.776848 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:55.355826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5108): Launched 07:03:55.684609 run osmo-stp_10.42.42.5(pid=5109): Launched 07:03:55.809559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:56.377691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5111): Launched 07:03:56.502189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:56.780662 run patchelf(pid=5112): Launched 07:03:56.963578 run osmo-stp_10.42.42.5(pid=5109): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5109)] 07:03:57.101940 run osmo-stp_10.42.42.5(pid=5109): stdout: | (launched: 2022-12-09_07:03:55.623061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:57.241472 run osmo-stp_10.42.42.5(pid=5109): stderr: | 20221209070355821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070355821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070355821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070355821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070355822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070355822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070355822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:57.381546 run osmo-stp_10.42.42.5(pid=5109): stdout: | (launched: 2022-12-09_07:03:55.623061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:57.515894 run osmo-stp_10.42.42.5(pid=5109): stderr: | 20221209070355821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070355821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070355821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070355821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070355822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070355822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070355822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:57.675099 run patchelf(pid=5112): Terminating (SIGINT) 07:03:57.857254 run patchelf(pid=5112): Terminated: ok {rc=0} 07:03:57.988046 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5109): Process ended prematurely: osmo-stp_10.42.42.5(pid=5109) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5109)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 07:03:57.997733 tst ping.py:22: Test FAILED (6.8 sec) 07:03:58.026063 run osmo-hlr_10.42.42.2(pid=5106): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5106)] 07:03:58.076272 run osmo-hlr_10.42.42.2(pid=5106): stdout: | (launched: 2022-12-09_07:03:54.588614) 07:03:58.128026 run osmo-hlr_10.42.42.2(pid=5106): stderr: | 20221209070354792 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070354792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070354792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070354792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070354792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070354792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070354805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070354813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070354814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070354814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:58.180313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5105): Terminating (SIGTERM) 07:03:58.222380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5108): Terminating (SIGTERM) 07:03:58.264411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5111): Terminating (SIGTERM) 07:03:58.306873 --- ParallelTerminationStrategy: PID 5105 died... 07:03:58.327090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5105): Terminated: ok {rc=0} 07:03:58.373629 --- ParallelTerminationStrategy: PID 5108 died... 07:03:58.393361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5108): Terminated: ok {rc=0} 07:03:58.439398 --- ParallelTerminationStrategy: PID 5111 died... 07:03:58.459059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5111): Terminated: ok {rc=0} 07:03:58.546997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:03:59.632812 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:59.644709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:03:59.705039 tst ping_idle_ping.py: using LAC 19754 07:03:59.826203 tst ping_idle_ping.py: using RAC 119 07:03:59.945376 tst ping_idle_ping.py: using CellId 19754 07:04:00.067133 tst ping_idle_ping.py: using BVCI 19755 07:04:00.179778 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.190791 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.201645 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.212685 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.223658 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.234563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.245694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:00.256709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:04:00.378046 tst ping_idle_ping.py:24: start network... 07:04:00.600669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:01.138308 run create_hlr_db(pid=5113): Launched 07:04:01.290123 bus /gobi_6: Setting Powered False 07:04:02.351356 run create_hlr_db(pid=5113): Terminated: ok {rc=0} 07:04:02.807382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5115): Launched 07:04:03.141398 run osmo-hlr_10.42.42.2(pid=5116): Launched 07:04:03.266536 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:03.834171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5118): Launched 07:04:04.168683 run osmo-stp_10.42.42.5(pid=5119): Launched 07:04:04.294235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:04.866754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5121): Launched 07:04:04.993562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:05.273590 run patchelf(pid=5122): Launched 07:04:05.456002 run osmo-stp_10.42.42.5(pid=5119): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5119)] 07:04:05.594565 run osmo-stp_10.42.42.5(pid=5119): stdout: | (launched: 2022-12-09_07:04:04.106553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:05.734887 run osmo-stp_10.42.42.5(pid=5119): stderr: | 20221209070404301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070404301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070404302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070404302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070404302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070404303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070404303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:05.875534 run osmo-stp_10.42.42.5(pid=5119): stdout: | (launched: 2022-12-09_07:04:04.106553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:06.010234 run osmo-stp_10.42.42.5(pid=5119): stderr: | 20221209070404301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070404301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070404302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070404302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070404302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070404303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070404303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:06.169395 run patchelf(pid=5122): Terminating (SIGINT) 07:04:06.352060 run patchelf(pid=5122): Terminated: ok {rc=0} 07:04:06.483707 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5119): Process ended prematurely: osmo-stp_10.42.42.5(pid=5119) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5119)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:04:06.493356 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 07:04:06.521577 run osmo-hlr_10.42.42.2(pid=5116): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5116)] 07:04:06.571867 run osmo-hlr_10.42.42.2(pid=5116): stdout: | (launched: 2022-12-09_07:04:03.078949) 07:04:06.623763 run osmo-hlr_10.42.42.2(pid=5116): stderr: | 20221209070403282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070403282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070403282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070403282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070403282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070403282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070403295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070403303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070403303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070403303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:06.676144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5115): Terminating (SIGTERM) 07:04:06.718080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5118): Terminating (SIGTERM) 07:04:06.760155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5121): Terminating (SIGTERM) 07:04:06.802623 --- ParallelTerminationStrategy: PID 5115 died... 07:04:06.822826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5115): Terminated: ok {rc=0} 07:04:06.869799 --- ParallelTerminationStrategy: PID 5118 died... 07:04:06.889674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5118): Terminated: ok {rc=0} 07:04:06.936135 --- ParallelTerminationStrategy: PID 5121 died... 07:04:06.956151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5121): Terminated: ok {rc=0} 07:04:07.045288 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:04:08.339678 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:08.345839 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:04:08.367142 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:04:08.407563 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:04:08.497205 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:04:08.518745 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:04:08.557514 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:04:09.158238 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:04:09.212711 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.224398 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:04:09.284272 tst cs_paging_gprs_active.py: using LAC 19755 07:04:09.417339 tst cs_paging_gprs_active.py: using RAC 120 07:04:09.550474 tst cs_paging_gprs_active.py: using CellId 19755 07:04:09.683597 tst cs_paging_gprs_active.py: using BVCI 19756 07:04:09.807606 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.819025 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.830217 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.842110 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.854042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.865661 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.877394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.888811 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:09.900458 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:10.019550 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:10.137725 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:04:10.348503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:10.664318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5126): Launched 07:04:10.956092 run iperf3-srv_10.42.42.10(pid=5127): Launched 07:04:11.082029 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:04:11.307875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:11.645284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5128): Launched 07:04:11.958096 run iperf3-srv_10.42.42.10(pid=5129): Launched 07:04:12.083594 tst cs_paging_gprs_active.py:38: start network... 07:04:12.309479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:12.830870 run create_hlr_db(pid=5130): Launched 07:04:12.967707 bus /gobi_6: Setting Powered False 07:04:14.033519 run create_hlr_db(pid=5130): Terminated: ok {rc=0} 07:04:14.499474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5132): Launched 07:04:14.835941 run osmo-hlr_10.42.42.2(pid=5133): Launched 07:04:14.962385 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:15.535853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5135): Launched 07:04:15.877654 run osmo-stp_10.42.42.5(pid=5136): Launched 07:04:16.072627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:16.730104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5138): Launched 07:04:16.870730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:17.193523 run patchelf(pid=5139): Launched 07:04:17.384738 run osmo-stp_10.42.42.5(pid=5136): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5136)] 07:04:17.516874 run osmo-stp_10.42.42.5(pid=5136): stdout: | (launched: 2022-12-09_07:04:15.808432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:17.650970 run osmo-stp_10.42.42.5(pid=5136): stderr: | 20221209070416182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070416182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070416182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070416182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070416183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070416183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070416183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:17.784601 run osmo-stp_10.42.42.5(pid=5136): stdout: | (launched: 2022-12-09_07:04:15.808432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:17.912755 run osmo-stp_10.42.42.5(pid=5136): stderr: | 20221209070416182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070416182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070416182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070416182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070416183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070416183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070416183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:18.064239 run patchelf(pid=5139): Terminating (SIGINT) 07:04:18.238636 run patchelf(pid=5139): Terminated: ok {rc=0} 07:04:18.364548 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5136): Process ended prematurely: osmo-stp_10.42.42.5(pid=5136) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5136)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:04:18.374428 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 07:04:18.402331 run osmo-hlr_10.42.42.2(pid=5133): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5133)] 07:04:18.450993 run osmo-hlr_10.42.42.2(pid=5133): stdout: | (launched: 2022-12-09_07:04:14.772886) 07:04:18.501123 run osmo-hlr_10.42.42.2(pid=5133): stderr: | 20221209070414975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070414975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070414975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070414975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070414976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070414976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070414990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070414998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070414998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070414998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:18.551785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5126): Terminating (SIGTERM) 07:04:18.591987 run iperf3-srv_10.42.42.10(pid=5127): Terminating (SIGTERM) 07:04:18.632040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5128): Terminating (SIGTERM) 07:04:18.672333 run iperf3-srv_10.42.42.10(pid=5129): Terminating (SIGTERM) 07:04:18.712150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5132): Terminating (SIGTERM) 07:04:18.751825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5135): Terminating (SIGTERM) 07:04:18.791735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5138): Terminating (SIGTERM) 07:04:18.832757 --- ParallelTerminationStrategy: PID 5126 died... 07:04:18.851831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5126): Terminated: ok {rc=0} 07:04:18.896821 --- ParallelTerminationStrategy: PID 5127 died... 07:04:18.915956 run iperf3-srv_10.42.42.10(pid=5127): Terminated {rc=256} 07:04:18.960170 --- ParallelTerminationStrategy: PID 5128 died... 07:04:18.979151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5128): Terminated: ok {rc=0} 07:04:19.023635 --- ParallelTerminationStrategy: PID 5129 died... 07:04:19.042320 run iperf3-srv_10.42.42.10(pid=5129): Terminated {rc=256} 07:04:19.086740 --- ParallelTerminationStrategy: PID 5132 died... 07:04:19.105432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5132): Terminated: ok {rc=0} 07:04:19.150384 --- ParallelTerminationStrategy: PID 5135 died... 07:04:19.169188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5135): Terminated: ok {rc=0} 07:04:19.213874 --- ParallelTerminationStrategy: PID 5138 died... 07:04:19.232649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5138): Terminated: ok {rc=0} 07:04:19.319934 bus /gobi_0: Setting Powered False 07:04:20.420450 bus /gobi_0: Setting Powered False 07:04:21.536259 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:04:22.684907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:22.696647 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:04:22.757309 tst iperf3.py: using LAC 19756 07:04:22.881370 tst iperf3.py: using RAC 121 07:04:23.006268 tst iperf3.py: using CellId 19756 07:04:23.127917 tst iperf3.py: using BVCI 19757 07:04:23.242592 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.253660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.264499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.275579 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.286535 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.297508 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.308625 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.319742 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:23.330848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:23.452746 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:04:23.679834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:24.017304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5140): Launched 07:04:24.309944 run iperf3-srv_10.42.42.10(pid=5141): Launched 07:04:24.437974 tst iperf3.py:8: start network... 07:04:24.663142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:25.183204 run create_hlr_db(pid=5142): Launched 07:04:25.319060 bus /gobi_6: Setting Powered False 07:04:26.384857 run create_hlr_db(pid=5142): Terminated: ok {rc=0} 07:04:26.850808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5144): Launched 07:04:27.186755 run osmo-hlr_10.42.42.2(pid=5145): Launched 07:04:27.314579 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:27.894012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5147): Launched 07:04:28.229469 run osmo-stp_10.42.42.5(pid=5148): Launched 07:04:28.356762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:28.934831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5150): Launched 07:04:29.062018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:29.348079 run patchelf(pid=5151): Launched 07:04:29.533075 run osmo-stp_10.42.42.5(pid=5148): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5148)] 07:04:29.673771 run osmo-stp_10.42.42.5(pid=5148): stdout: | (launched: 2022-12-09_07:04:28.166677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:29.816093 run osmo-stp_10.42.42.5(pid=5148): stderr: | 20221209070428363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070428363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070428364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070428364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070428364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070428364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070428365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:29.958830 run osmo-stp_10.42.42.5(pid=5148): stdout: | (launched: 2022-12-09_07:04:28.166677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:30.095486 run osmo-stp_10.42.42.5(pid=5148): stderr: | 20221209070428363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070428363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070428364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070428364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070428364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070428364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070428365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:30.257446 run patchelf(pid=5151): Terminating (SIGINT) 07:04:30.443435 run patchelf(pid=5151): Terminated: ok {rc=0} 07:04:30.577665 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5148): Process ended prematurely: osmo-stp_10.42.42.5(pid=5148) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5148)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 07:04:30.588029 tst iperf3.py:8: Test FAILED (7.9 sec) 07:04:30.616916 run osmo-hlr_10.42.42.2(pid=5145): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5145)] 07:04:30.667785 run osmo-hlr_10.42.42.2(pid=5145): stdout: | (launched: 2022-12-09_07:04:27.123686) 07:04:30.720542 run osmo-hlr_10.42.42.2(pid=5145): stderr: | 20221209070427328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070427328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070427328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070427328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070427328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070427328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070427353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070427363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070427363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070427363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:30.773593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5140): Terminating (SIGTERM) 07:04:30.816106 run iperf3-srv_10.42.42.10(pid=5141): Terminating (SIGTERM) 07:04:30.881192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5144): Terminating (SIGTERM) 07:04:30.925721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5147): Terminating (SIGTERM) 07:04:30.971047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5150): Terminating (SIGTERM) 07:04:31.016685 --- ParallelTerminationStrategy: PID 5140 died... 07:04:31.037842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5140): Terminated: ok {rc=0} 07:04:31.086184 --- ParallelTerminationStrategy: PID 5141 died... 07:04:31.107186 run iperf3-srv_10.42.42.10(pid=5141): Terminated {rc=256} 07:04:31.155071 --- ParallelTerminationStrategy: PID 5144 died... 07:04:31.175644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5144): Terminated: ok {rc=0} 07:04:31.224451 --- ParallelTerminationStrategy: PID 5147 died... 07:04:31.245440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5147): Terminated: ok {rc=0} 07:04:31.293680 --- ParallelTerminationStrategy: PID 5150 died... 07:04:31.314156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5150): Terminated: ok {rc=0} 07:04:31.411073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:04:32.574956 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:32.587141 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:04:32.647721 tst iperf3m4.py: using LAC 19757 07:04:32.778463 tst iperf3m4.py: using RAC 122 07:04:32.902263 tst iperf3m4.py: using CellId 19757 07:04:33.024717 tst iperf3m4.py: using BVCI 19758 07:04:33.140346 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.151461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.162631 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.174644 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.186251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.197934 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.209807 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.221338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:33.233311 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:33.358656 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:33.481864 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:33.601680 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:33.725241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:04:33.952499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:34.289945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5152): Launched 07:04:34.582909 run iperf3-srv_10.42.42.10(pid=5153): Launched 07:04:34.708048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:04:34.933757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:35.271261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5154): Launched 07:04:35.562766 run iperf3-srv_10.42.42.10(pid=5155): Launched 07:04:35.687379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:04:35.912928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:36.249464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5156): Launched 07:04:36.540594 run iperf3-srv_10.42.42.10(pid=5157): Launched 07:04:36.665315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:04:36.890540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:37.227694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5158): Launched 07:04:37.519440 run iperf3-srv_10.42.42.10(pid=5159): Launched 07:04:37.643683 tst iperf3m4.py:8: start network... 07:04:37.868908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:38.388082 run create_hlr_db(pid=5160): Launched 07:04:38.523046 bus /gobi_6: Setting Powered False 07:04:39.588052 run create_hlr_db(pid=5160): Terminated: ok {rc=0} 07:04:40.035680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5162): Launched 07:04:40.350503 run osmo-hlr_10.42.42.2(pid=5163): Launched 07:04:40.469562 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:41.055545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5165): Launched 07:04:41.392334 run osmo-stp_10.42.42.5(pid=5166): Launched 07:04:41.521437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:42.102067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5168): Launched 07:04:42.229320 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:42.514406 run patchelf(pid=5169): Launched 07:04:42.699527 run osmo-stp_10.42.42.5(pid=5166): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5166)] 07:04:42.840329 run osmo-stp_10.42.42.5(pid=5166): stdout: | (launched: 2022-12-09_07:04:41.329325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:42.983563 run osmo-stp_10.42.42.5(pid=5166): stderr: | 20221209070441525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070441525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070441525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070441526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070441526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070441526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070441526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:43.126401 run osmo-stp_10.42.42.5(pid=5166): stdout: | (launched: 2022-12-09_07:04:41.329325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:43.263091 run osmo-stp_10.42.42.5(pid=5166): stderr: | 20221209070441525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070441525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070441525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070441526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070441526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070441526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070441526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:43.426578 run patchelf(pid=5169): Terminating (SIGINT) 07:04:43.612544 run patchelf(pid=5169): Terminated: ok {rc=0} 07:04:43.746356 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5166): Process ended prematurely: osmo-stp_10.42.42.5(pid=5166) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5166)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:04:43.756657 tst iperf3m4.py:8: Test FAILED (11.2 sec) 07:04:43.785876 run osmo-hlr_10.42.42.2(pid=5163): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5163)] 07:04:43.836339 run osmo-hlr_10.42.42.2(pid=5163): stdout: | (launched: 2022-12-09_07:04:40.290739) 07:04:43.889103 run osmo-hlr_10.42.42.2(pid=5163): stderr: | 20221209070440472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070440472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070440472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070440472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070440472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070440472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070440484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070440492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070440492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070440492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:43.941497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5152): Terminating (SIGTERM) 07:04:43.983353 run iperf3-srv_10.42.42.10(pid=5153): Terminating (SIGTERM) 07:04:44.025079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5154): Terminating (SIGTERM) 07:04:44.066976 run iperf3-srv_10.42.42.10(pid=5155): Terminating (SIGTERM) 07:04:44.109216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5156): Terminating (SIGTERM) 07:04:44.151713 run iperf3-srv_10.42.42.10(pid=5157): Terminating (SIGTERM) 07:04:44.193979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5158): Terminating (SIGTERM) 07:04:44.236312 run iperf3-srv_10.42.42.10(pid=5159): Terminating (SIGTERM) 07:04:44.278504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5162): Terminating (SIGTERM) 07:04:44.320911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5165): Terminating (SIGTERM) 07:04:44.363352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5168): Terminating (SIGTERM) 07:04:44.405939 --- ParallelTerminationStrategy: PID 5152 died... 07:04:44.426266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5152): Terminated: ok {rc=0} 07:04:44.473096 --- ParallelTerminationStrategy: PID 5153 died... 07:04:44.492909 run iperf3-srv_10.42.42.10(pid=5153): Terminated {rc=256} 07:04:44.539509 --- ParallelTerminationStrategy: PID 5154 died... 07:04:44.559345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5154): Terminated: ok {rc=0} 07:04:44.606195 --- ParallelTerminationStrategy: PID 5155 died... 07:04:44.625998 run iperf3-srv_10.42.42.10(pid=5155): Terminated {rc=256} 07:04:44.672516 --- ParallelTerminationStrategy: PID 5156 died... 07:04:44.692401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5156): Terminated: ok {rc=0} 07:04:44.739184 --- ParallelTerminationStrategy: PID 5157 died... 07:04:44.758937 run iperf3-srv_10.42.42.10(pid=5157): Terminated {rc=256} 07:04:44.805420 --- ParallelTerminationStrategy: PID 5158 died... 07:04:44.825246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5158): Terminated: ok {rc=0} 07:04:44.872454 --- ParallelTerminationStrategy: PID 5159 died... 07:04:44.892272 run iperf3-srv_10.42.42.10(pid=5159): Terminated {rc=256} 07:04:44.939001 --- ParallelTerminationStrategy: PID 5162 died... 07:04:44.958991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5162): Terminated: ok {rc=0} 07:04:45.005806 --- ParallelTerminationStrategy: PID 5165 died... 07:04:45.025611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5165): Terminated: ok {rc=0} 07:04:45.072117 --- ParallelTerminationStrategy: PID 5168 died... 07:04:45.092014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5168): Terminated: ok {rc=0} 07:04:45.181369 bus /gobi_4: Setting Powered False 07:04:46.286972 bus /gobi_4: Setting Powered False 07:04:47.403251 bus /gobi_1: Setting Powered False 07:04:48.503418 bus /gobi_1: Setting Powered False 07:04:49.621585 bus /gobi_0: Setting Powered False 07:04:50.721475 bus /gobi_0: Setting Powered False 07:04:51.842132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:04:52.947871 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:52.959939 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:04:53.019585 tst ping.py: using LAC 19758 07:04:53.147990 tst ping.py: using RAC 123 07:04:53.276000 tst ping.py: using CellId 19758 07:04:53.398635 tst ping.py: using BVCI 19759 07:04:53.512604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.523955 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.534833 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.545846 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.557420 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.569401 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.581938 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:53.593614 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:53.715958 tst ping.py:19: start network... 07:04:53.937432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:54.448713 run create_hlr_db(pid=5170): Launched 07:04:54.582564 bus /gobi_6: Setting Powered False 07:04:55.647606 run create_hlr_db(pid=5170): Terminated: ok {rc=0} 07:04:56.085795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5173): Launched 07:04:56.395268 run osmo-hlr_10.42.42.2(pid=5174): Launched 07:04:56.512278 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:57.043860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5176): Launched 07:04:57.351346 run osmo-stp_10.42.42.5(pid=5177): Launched 07:04:57.468822 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:58.000698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5179): Launched 07:04:58.117863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:58.377559 run patchelf(pid=5180): Launched 07:04:58.547435 run osmo-stp_10.42.42.5(pid=5177): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5177)] 07:04:58.676013 run osmo-stp_10.42.42.5(pid=5177): stdout: | (launched: 2022-12-09_07:04:57.292870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:58.806387 run osmo-stp_10.42.42.5(pid=5177): stderr: | 20221209070457466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070457466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070457466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070457467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070457467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070457467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070457467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:58.937597 run osmo-stp_10.42.42.5(pid=5177): stdout: | (launched: 2022-12-09_07:04:57.292870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:59.062465 run osmo-stp_10.42.42.5(pid=5177): stderr: | 20221209070457466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070457466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070457466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070457467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070457467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070457467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070457467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:59.210668 run patchelf(pid=5180): Terminating (SIGINT) 07:04:59.381358 run patchelf(pid=5180): Terminated: ok {rc=0} 07:04:59.504821 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5177): Process ended prematurely: osmo-stp_10.42.42.5(pid=5177) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5177)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 07:04:59.513942 tst ping.py:22: Test FAILED (6.6 sec) 07:04:59.541198 run osmo-hlr_10.42.42.2(pid=5174): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5174)] 07:04:59.590440 run osmo-hlr_10.42.42.2(pid=5174): stdout: | (launched: 2022-12-09_07:04:56.336896) 07:04:59.641639 run osmo-hlr_10.42.42.2(pid=5174): stderr: | 20221209070456515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070456515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070456515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070456515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070456515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070456516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070456528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070456538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070456538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070456538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:59.692880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5173): Terminating (SIGTERM) 07:04:59.733467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5176): Terminating (SIGTERM) 07:04:59.773940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5179): Terminating (SIGTERM) 07:04:59.814695 --- ParallelTerminationStrategy: PID 5173 died... 07:04:59.834440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5173): Terminated: ok {rc=0} 07:04:59.878914 --- ParallelTerminationStrategy: PID 5176 died... 07:04:59.897863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5176): Terminated: ok {rc=0} 07:04:59.942133 --- ParallelTerminationStrategy: PID 5179 died... 07:04:59.961275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5179): Terminated: ok {rc=0} 07:05:00.045081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:05:01.137991 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.155365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:05:01.229181 tst ping_idle_ping.py: using LAC 19759 07:05:01.366323 tst ping_idle_ping.py: using RAC 124 07:05:01.492637 tst ping_idle_ping.py: using CellId 19759 07:05:01.640263 tst ping_idle_ping.py: using BVCI 19760 07:05:01.755745 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.767713 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.780296 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.792780 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.810911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.823607 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.836931 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:01.849968 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:05:01.991407 tst ping_idle_ping.py:24: start network... 07:05:02.261365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:02.780594 run create_hlr_db(pid=5184): Launched 07:05:02.916290 bus /gobi_6: Setting Powered False 07:05:03.981375 run create_hlr_db(pid=5184): Terminated: ok {rc=0} 07:05:04.422024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5186): Launched 07:05:04.733123 run osmo-hlr_10.42.42.2(pid=5187): Launched 07:05:04.852430 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:05.395604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5189): Launched 07:05:05.705210 run osmo-stp_10.42.42.5(pid=5190): Launched 07:05:05.823060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:06.355268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5192): Launched 07:05:06.472342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:06.733837 run patchelf(pid=5193): Launched 07:05:06.904724 run osmo-stp_10.42.42.5(pid=5190): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5190)] 07:05:07.034887 run osmo-stp_10.42.42.5(pid=5190): stdout: | (launched: 2022-12-09_07:05:05.646199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:07.166438 run osmo-stp_10.42.42.5(pid=5190): stderr: | 20221209070505819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070505819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070505819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070505820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070505820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070505820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070505820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:07.298514 run osmo-stp_10.42.42.5(pid=5190): stdout: | (launched: 2022-12-09_07:05:05.646199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:07.424773 run osmo-stp_10.42.42.5(pid=5190): stderr: | 20221209070505819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070505819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070505819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070505820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070505820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070505820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070505820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:07.574646 run patchelf(pid=5193): Terminating (SIGINT) 07:05:07.746719 run patchelf(pid=5193): Terminated: ok {rc=0} 07:05:07.870347 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5190): Process ended prematurely: osmo-stp_10.42.42.5(pid=5190) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5190)] [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:05:07.879370 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:05:07.906430 run osmo-hlr_10.42.42.2(pid=5187): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5187)] 07:05:07.955421 run osmo-hlr_10.42.42.2(pid=5187): stdout: | (launched: 2022-12-09_07:05:04.673744) 07:05:08.005783 run osmo-hlr_10.42.42.2(pid=5187): stderr: | 20221209070504852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070504852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070504853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070504853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070504853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070504853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070504864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070504873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070504873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070504874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:08.056259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5186): Terminating (SIGTERM) 07:05:08.096758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5189): Terminating (SIGTERM) 07:05:08.137346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5192): Terminating (SIGTERM) 07:05:08.178261 --- ParallelTerminationStrategy: PID 5186 died... 07:05:08.197941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5186): Terminated: ok {rc=0} 07:05:08.242546 --- ParallelTerminationStrategy: PID 5189 died... 07:05:08.261800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5189): Terminated: ok {rc=0} 07:05:08.306596 --- ParallelTerminationStrategy: PID 5192 died... 07:05:08.325877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5192): Terminated: ok {rc=0} 07:05:08.412742 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:05:09.706815 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:09.713328 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:05:09.734975 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:05:09.771444 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:05:09.826063 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:05:09.846981 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:05:09.883344 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:05:10.439753 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:05:10.445330 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:10.456679 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:05:10.517119 tst switch_tch_pdch.py: using LAC 19760 07:05:10.639569 tst switch_tch_pdch.py: using RAC 125 07:05:10.761486 tst switch_tch_pdch.py: using CellId 19760 07:05:10.880589 tst switch_tch_pdch.py: using BVCI 19761 07:05:10.993597 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.004845 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.015978 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.027359 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.038622 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.049958 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.061612 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:05:11.072895 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:05:11.190083 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:05:11.307263 tst switch_tch_pdch.py:51: start network... 07:05:11.511002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:11.986810 run create_hlr_db(pid=5198): Launched 07:05:12.102882 bus /gobi_6: Setting Powered False 07:05:13.163901 run create_hlr_db(pid=5198): Terminated: ok {rc=0} 07:05:13.613537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5200): Launched 07:05:13.943937 run osmo-hlr_10.42.42.2(pid=5201): Launched 07:05:14.069137 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:14.637359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5203): Launched 07:05:14.966575 run osmo-stp_10.42.42.5(pid=5204): Launched 07:05:15.092578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:15.664512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5206): Launched 07:05:15.789675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:16.088425 run patchelf(pid=5207): Launched 07:05:16.285556 run osmo-stp_10.42.42.5(pid=5204): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5204)] 07:05:16.426401 run osmo-stp_10.42.42.5(pid=5204): stdout: | (launched: 2022-12-09_07:05:14.904262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:16.564087 run osmo-stp_10.42.42.5(pid=5204): stderr: | 20221209070515098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070515099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070515099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070515099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070515102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070515102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070515102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:16.701505 run osmo-stp_10.42.42.5(pid=5204): stdout: | (launched: 2022-12-09_07:05:14.904262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:16.834407 run osmo-stp_10.42.42.5(pid=5204): stderr: | 20221209070515098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070515099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070515099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070515099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070515102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070515102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070515102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:16.989570 run patchelf(pid=5207): Terminating (SIGINT) 07:05:17.167194 run patchelf(pid=5207): Terminated: ok {rc=0} 07:05:17.293355 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5204): Process ended prematurely: osmo-stp_10.42.42.5(pid=5204) [trial-2356↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5204)] [trial-2356↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:05:17.302610 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 07:05:17.330084 run osmo-hlr_10.42.42.2(pid=5201): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5201)] 07:05:17.378894 run osmo-hlr_10.42.42.2(pid=5201): stdout: | (launched: 2022-12-09_07:05:13.882038) 07:05:17.429285 run osmo-hlr_10.42.42.2(pid=5201): stderr: | 20221209070514083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070514083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070514083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070514083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070514083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070514083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070514096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070514106 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070514106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070514106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:17.479927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5200): Terminating (SIGTERM) 07:05:17.520679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5203): Terminating (SIGTERM) 07:05:17.561454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5206): Terminating (SIGTERM) 07:05:17.602162 --- ParallelTerminationStrategy: PID 5200 died... 07:05:17.621671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5200): Terminated: ok {rc=0} 07:05:17.666527 --- ParallelTerminationStrategy: PID 5203 died... 07:05:17.685629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5203): Terminated: ok {rc=0} 07:05:17.730747 --- ParallelTerminationStrategy: PID 5206 died... 07:05:17.749558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5206): Terminated: ok {rc=0} 07:05:17.836351 bus /gobi_0: Setting Powered False 07:05:18.936197 bus /gobi_0: Setting Powered False 07:05:20.051809 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:05:21.293306 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:21.298969 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:05:21.319914 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:05:21.356281 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:05:21.408201 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:05:21.429368 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:05:21.464482 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:05:22.020666 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:05:22.025763 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.036771 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:05:22.092335 tst switch_tch_pdch.py: using LAC 19761 07:05:22.212026 tst switch_tch_pdch.py: using RAC 126 07:05:22.329908 tst switch_tch_pdch.py: using CellId 19761 07:05:22.449745 tst switch_tch_pdch.py: using BVCI 19762 07:05:22.562624 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.573827 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.584663 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.595734 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.606476 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.617660 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.628653 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:05:22.639996 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:05:22.758634 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:05:22.883042 tst switch_tch_pdch.py:51: start network... 07:05:23.106104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:23.590821 run create_hlr_db(pid=5211): Launched 07:05:23.724664 bus /gobi_6: Setting Powered False 07:05:24.790016 run create_hlr_db(pid=5211): Terminated: ok {rc=0} 07:05:25.204094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5213): Launched 07:05:25.513348 run osmo-hlr_10.42.42.2(pid=5214): Launched 07:05:25.632033 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:26.138345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5216): Launched 07:05:26.445643 run osmo-stp_10.42.42.5(pid=5217): Launched 07:05:26.562681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:27.065240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5219): Launched 07:05:27.181625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:27.442062 run patchelf(pid=5220): Launched 07:05:27.612363 run osmo-stp_10.42.42.5(pid=5217): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5217)] 07:05:27.741984 run osmo-stp_10.42.42.5(pid=5217): stdout: | (launched: 2022-12-09_07:05:26.386901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:27.872637 run osmo-stp_10.42.42.5(pid=5217): stderr: | 20221209070526561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070526561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070526561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070526562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070526562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070526562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070526563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:28.002927 run osmo-stp_10.42.42.5(pid=5217): stdout: | (launched: 2022-12-09_07:05:26.386901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:28.127979 run osmo-stp_10.42.42.5(pid=5217): stderr: | 20221209070526561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070526561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070526561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070526562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070526562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070526562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070526563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:28.276800 run patchelf(pid=5220): Terminating (SIGINT) 07:05:28.446965 run patchelf(pid=5220): Terminated: ok {rc=0} 07:05:28.569553 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5217): Process ended prematurely: osmo-stp_10.42.42.5(pid=5217) [trial-2356↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5217)] [trial-2356↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:05:28.578548 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:05:28.605813 run osmo-hlr_10.42.42.2(pid=5214): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5214)] 07:05:28.654780 run osmo-hlr_10.42.42.2(pid=5214): stdout: | (launched: 2022-12-09_07:05:25.454910) 07:05:28.705177 run osmo-hlr_10.42.42.2(pid=5214): stderr: | 20221209070525635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070525635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070525635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070525635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070525635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070525635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070525646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070525655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070525655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070525655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:28.755561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5213): Terminating (SIGTERM) 07:05:28.795791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5216): Terminating (SIGTERM) 07:05:28.835816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5219): Terminating (SIGTERM) 07:05:28.876570 --- ParallelTerminationStrategy: PID 5213 died... 07:05:28.895625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5213): Terminated: ok {rc=0} 07:05:28.940616 --- ParallelTerminationStrategy: PID 5216 died... 07:05:28.959619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5216): Terminated: ok {rc=0} 07:05:29.004513 --- ParallelTerminationStrategy: PID 5219 died... 07:05:29.023525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5219): Terminated: ok {rc=0} 07:05:29.111203 bus /gobi_0: Setting Powered False 07:05:30.211985 bus /gobi_0: Setting Powered False 07:05:31.339054 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:oc2g --------------------------------------------------------------------- 07:05:32.601960 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:32.605973 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 07:05:32.627475 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 07:05:32.634638 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 07:05:32.686328 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 07:05:32.707786 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 07:05:32.714850 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 07:05:33.256363 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 07:05:33.261486 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 07:05:33.272622 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 07:05:33.308583 tst mo_mt_sms.py: using LAC 19762 07:05:33.438545 tst mo_mt_sms.py: using RAC 127 07:05:33.560940 tst mo_mt_sms.py: using CellId 19762 07:05:33.689314 tst mo_mt_sms.py: using BVCI 19763 07:05:33.809913 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 07:05:33.929442 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 07:05:34.051147 tst mo_mt_sms.py:9: start nitb and bts... 07:05:34.272813 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:05:34.944627 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5225): Launched 07:05:35.276564 run osmo-nitb_10.42.42.2(pid=5226): Launched 07:05:35.458423 run osmo-nitb_10.42.42.2(pid=5226): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5226)] 07:05:35.605040 run osmo-nitb_10.42.42.2(pid=5226): stdout: | (launched: 2022-12-09_07:05:35.213644) 07:05:35.753643 run osmo-nitb_10.42.42.2(pid=5226): stderr: | (launched: 2022-12-09_07:05:35.262713) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:05:35.901979 run osmo-nitb_10.42.42.2(pid=5226): stdout: | (launched: 2022-12-09_07:05:35.213644) 07:05:36.045293 run osmo-nitb_10.42.42.2(pid=5226): stderr: | (launched: 2022-12-09_07:05:35.262713) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5226): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5226) [trial-2356↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5226)] 07:05:36.400900 tst osmo-nitb_10.42.42.2(pid=5226): stdout: | (launched: 2022-12-09_07:05:35.213644) 07:05:36.532255 tst osmo-nitb_10.42.42.2(pid=5226): stderr: | (launched: 2022-12-09_07:05:35.262713) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:05:36.687913 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5226): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5226) [trial-2356↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5226)] [trial-2356↪nitb_sms:oc2g↪mo_mt_sms.py:11] 07:05:36.697220 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:05:36.704482 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5225): Terminating (SIGTERM) 07:05:36.915279 --- ParallelTerminationStrategy: PID 5225 died... 07:05:36.937338 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5225): Terminated: ok {rc=0} 07:05:37.026334 bus /sierra_3: Setting Powered False 07:05:38.127472 bus /sierra_3: Setting Powered False 07:05:39.244832 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:oc2g --------------------------------------------------------------------- 07:05:40.431278 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:40.435621 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 07:05:40.457251 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 07:05:40.485520 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 07:05:40.539211 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 07:05:40.560727 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 07:05:40.588338 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 07:05:41.136169 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:oc2g mo_mt_sms.py ---------------------------------------------- 07:05:41.141401 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:05:41.152352 tst sms:oc2g: Using 1 x bts (candidates: 1) 07:05:41.188451 tst mo_mt_sms.py: using LAC 19763 07:05:41.316817 tst mo_mt_sms.py: using RAC 128 07:05:41.444905 tst mo_mt_sms.py: using CellId 19763 07:05:41.579086 tst mo_mt_sms.py: using BVCI 19764 07:05:41.699810 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:05:41.710937 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:05:41.721912 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:05:41.732783 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:05:41.743768 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:05:41.754776 tst sms:oc2g: Using 1 x modem (candidates: 2) 07:05:41.873699 tst sms:oc2g: Using 1 x modem (candidates: 2) 07:05:41.994298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:42.506769 run create_hlr_db(pid=5232): Launched 07:05:42.639433 bus /sierra_2: Setting Powered False 07:05:43.703889 run create_hlr_db(pid=5232): Terminated: ok {rc=0} 07:05:44.143383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5234): Launched 07:05:44.451063 run osmo-hlr_10.42.42.2(pid=5235): Launched 07:05:44.567843 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:45.100783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5237): Launched 07:05:45.408906 run osmo-stp_10.42.42.5(pid=5238): Launched 07:05:45.526213 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:46.138748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5240): Launched 07:05:46.487697 run osmo-msc_10.42.42.6(pid=5241): Launched 07:05:46.892462 run osmo-stp_10.42.42.5(pid=5238): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5238)] 07:05:47.168308 run osmo-stp_10.42.42.5(pid=5238): stdout: | (launched: 2022-12-09_07:05:45.350020) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:47.307925 run osmo-stp_10.42.42.5(pid=5238): stderr: | 20221209070545523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070545523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070545524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070545524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070545524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070545525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070545525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:47.445423 run osmo-stp_10.42.42.5(pid=5238): stdout: | (launched: 2022-12-09_07:05:45.350020) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:47.576692 run osmo-stp_10.42.42.5(pid=5238): stderr: | 20221209070545523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070545523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070545524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070545524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070545524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070545525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070545525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:47.733471 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5238): Process ended prematurely: osmo-stp_10.42.42.5(pid=5238) [trial-2356↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5238)] [trial-2356↪sms:oc2g↪mo_mt_sms.py:16] 07:05:47.742559 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 07:05:47.770300 run osmo-hlr_10.42.42.2(pid=5235): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5235)] 07:05:47.821497 run osmo-hlr_10.42.42.2(pid=5235): stdout: | (launched: 2022-12-09_07:05:44.392361) 07:05:47.874415 run osmo-hlr_10.42.42.2(pid=5235): stderr: | 20221209070544573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070544573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070544573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070544573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070544574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070544574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070544585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070544594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070544594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070544594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:47.948471 run osmo-msc_10.42.42.6(pid=5241): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5241)] 07:05:47.999248 run osmo-msc_10.42.42.6(pid=5241): stdout: | (launched: 2022-12-09_07:05:46.422889) 07:05:48.051866 run osmo-msc_10.42.42.6(pid=5241): stderr: | 20221209070546873 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070546874 DLGLOBAL DEBUG validating counter group 0x7f9a9fe75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070546874 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070546874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070546874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070546874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070546876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070546876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070546876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070546876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:05:48.104244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5234): Terminating (SIGTERM) 07:05:48.146281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5237): Terminating (SIGTERM) 07:05:48.188356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5240): Terminating (SIGTERM) 07:05:48.230792 --- ParallelTerminationStrategy: PID 5234 died... 07:05:48.250511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5234): Terminated: ok {rc=0} 07:05:48.297106 --- ParallelTerminationStrategy: PID 5237 died... 07:05:48.316721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5237): Terminated: ok {rc=0} 07:05:48.363158 --- ParallelTerminationStrategy: PID 5240 died... 07:05:48.382936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5240): Terminated: ok {rc=0} 07:05:48.471186 bus /sierra_3: Setting Powered False 07:05:49.570404 bus /sierra_3: Setting Powered False 07:05:50.688370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:oc2g --------------------------------------------------------------------- 07:05:51.907287 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:51.911380 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 07:05:51.933061 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 07:05:51.940197 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 07:05:51.977657 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 07:05:51.999898 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 07:05:52.007113 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 07:05:52.525891 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 07:05:52.531202 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 07:05:52.542619 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 07:05:52.578482 tst assert_extension.py: using LAC 19764 07:05:52.720095 tst assert_extension.py: using RAC 129 07:05:52.843903 tst assert_extension.py: using CellId 19764 07:05:52.964938 tst assert_extension.py: using BVCI 19765 07:05:53.075015 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 07:05:53.195963 tst assert_extension.py:10: start nitb and bts... 07:05:53.401809 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:05:54.029465 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5248): Launched 07:05:54.337810 run osmo-nitb_10.42.42.2(pid=5249): Launched 07:05:54.507704 run osmo-nitb_10.42.42.2(pid=5249): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5249)] 07:05:54.645348 run osmo-nitb_10.42.42.2(pid=5249): stdout: | (launched: 2022-12-09_07:05:54.279317) 07:05:54.784319 run osmo-nitb_10.42.42.2(pid=5249): stderr: | (launched: 2022-12-09_07:05:54.324607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:05:54.923052 run osmo-nitb_10.42.42.2(pid=5249): stdout: | (launched: 2022-12-09_07:05:54.279317) 07:05:55.056889 run osmo-nitb_10.42.42.2(pid=5249): stderr: | (launched: 2022-12-09_07:05:54.324607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5249) [trial-2356↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5249)] 07:05:55.454037 tst osmo-nitb_10.42.42.2(pid=5249): stdout: | (launched: 2022-12-09_07:05:54.279317) 07:05:55.578542 tst osmo-nitb_10.42.42.2(pid=5249): stderr: | (launched: 2022-12-09_07:05:54.324607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:05:55.723414 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5249) [trial-2356↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5249)] [trial-2356↪nitb_ussd:oc2g↪assert_extension.py:12] 07:05:55.731799 tst assert_extension.py:12: Test FAILED (3.2 sec) 07:05:55.738516 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5248): Terminating (SIGTERM) 07:05:55.947869 --- ParallelTerminationStrategy: PID 5248 died... 07:05:55.968564 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5248): Terminated: ok {rc=0} 07:05:56.054396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:oc2g --------------------------------------------------------------------- 07:05:57.216152 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:57.221634 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 07:05:57.244659 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 07:05:57.272150 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 07:05:57.312064 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 07:05:57.334775 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 07:05:57.362693 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 07:05:57.885080 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:oc2g assert_extension.py ---------------------------------------------- 07:05:57.890264 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:57.901210 tst ussd:oc2g: Using 1 x bts (candidates: 1) 07:05:57.935372 tst assert_extension.py: using LAC 19765 07:05:58.055586 tst assert_extension.py: using RAC 130 07:05:58.187336 tst assert_extension.py: using CellId 19765 07:05:58.316707 tst assert_extension.py: using BVCI 19766 07:05:58.437380 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:58.448523 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:58.459528 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:58.470697 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:58.481838 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:58.492591 tst ussd:oc2g: Using 1 x modem (candidates: 1) 07:05:58.609830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:59.086513 run create_hlr_db(pid=5253): Launched 07:05:59.203898 bus /sierra_2: Setting Powered False 07:06:00.265227 run create_hlr_db(pid=5253): Terminated: ok {rc=0} 07:06:00.716153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5255): Launched 07:06:01.075324 run osmo-hlr_10.42.42.2(pid=5256): Launched 07:06:01.246734 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:02.024292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5258): Launched 07:06:02.352163 run osmo-stp_10.42.42.5(pid=5259): Launched 07:06:02.470921 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:03.025580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5261): Launched 07:06:03.332921 run osmo-msc_10.42.42.6(pid=5262): Launched 07:06:03.504323 run osmo-stp_10.42.42.5(pid=5259): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5259)] 07:06:03.634813 run osmo-stp_10.42.42.5(pid=5259): stdout: | (launched: 2022-12-09_07:06:02.292866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:03.765071 run osmo-stp_10.42.42.5(pid=5259): stderr: | 20221209070602466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070602466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070602466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070602467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070602467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070602467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070602467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:03.893808 run osmo-stp_10.42.42.5(pid=5259): stdout: | (launched: 2022-12-09_07:06:02.292866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:04.016323 run osmo-stp_10.42.42.5(pid=5259): stderr: | 20221209070602466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070602466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070602466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070602467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070602467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070602467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070602467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:04.162697 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5259): Process ended prematurely: osmo-stp_10.42.42.5(pid=5259) [trial-2356↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5259)] [trial-2356↪ussd:oc2g↪assert_extension.py:17] 07:06:04.171246 tst assert_extension.py:17: Test FAILED (6.3 sec) 07:06:04.197649 run osmo-hlr_10.42.42.2(pid=5256): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5256)] 07:06:04.246424 run osmo-hlr_10.42.42.2(pid=5256): stdout: | (launched: 2022-12-09_07:06:01.007170) 07:06:04.296245 run osmo-hlr_10.42.42.2(pid=5256): stderr: | 20221209070601380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070601380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070601380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070601380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070601380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070601380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070601400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070601412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070601412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070601412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:04.365629 run osmo-msc_10.42.42.6(pid=5262): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5262)] 07:06:04.413690 run osmo-msc_10.42.42.6(pid=5262): stdout: | (launched: 2022-12-09_07:06:03.274496) 07:06:04.463406 run osmo-msc_10.42.42.6(pid=5262): stderr: | 20221209070603548 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070603549 DLGLOBAL DEBUG validating counter group 0x7f4a6a842c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070603549 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070603549 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070603549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070603549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070603551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070603551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070603552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070603552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:04.513671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5255): Terminating (SIGTERM) 07:06:04.554449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5258): Terminating (SIGTERM) 07:06:04.594681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5261): Terminating (SIGTERM) 07:06:04.635353 --- ParallelTerminationStrategy: PID 5255 died... 07:06:04.655111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5255): Terminated: ok {rc=0} 07:06:04.699831 --- ParallelTerminationStrategy: PID 5258 died... 07:06:04.718884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5258): Terminated: ok {rc=0} 07:06:04.763864 --- ParallelTerminationStrategy: PID 5261 died... 07:06:04.782692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5261): Terminated: ok {rc=0} 07:06:04.869421 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:06:06.067012 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:06.075648 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:06:06.097848 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:06:06.127475 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:06:06.182418 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:06:06.204242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:06:06.232775 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:06:06.784700 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:06:06.839957 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:06.852115 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:06:06.912699 tst mo_mt_call.py: using LAC 19766 07:06:07.045486 tst mo_mt_call.py: using RAC 131 07:06:07.177431 tst mo_mt_call.py: using CellId 19766 07:06:07.310548 tst mo_mt_call.py: using BVCI 19767 07:06:07.432831 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:07.444633 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:07.456288 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:07.467992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:07.480216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:07.491747 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:06:07.615823 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:06:07.734832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:08.222764 run create_hlr_db(pid=5267): Launched 07:06:08.342994 bus /sierra_2: Setting Powered False 07:06:09.404850 run create_hlr_db(pid=5267): Terminated: ok {rc=0} 07:06:09.862709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5269): Launched 07:06:10.200386 run osmo-hlr_10.42.42.2(pid=5270): Launched 07:06:10.328539 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:10.910395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5272): Launched 07:06:11.248708 run osmo-stp_10.42.42.5(pid=5273): Launched 07:06:11.376367 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:11.983596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5275): Launched 07:06:12.320726 run osmo-msc_10.42.42.6(pid=5276): Launched 07:06:12.506948 run osmo-stp_10.42.42.5(pid=5273): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5273)] 07:06:12.647560 run osmo-stp_10.42.42.5(pid=5273): stdout: | (launched: 2022-12-09_07:06:11.185641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:12.788120 run osmo-stp_10.42.42.5(pid=5273): stderr: | 20221209070611378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070611378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070611378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070611379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070611379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070611379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070611379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:12.927978 run osmo-stp_10.42.42.5(pid=5273): stdout: | (launched: 2022-12-09_07:06:11.185641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:13.061863 run osmo-stp_10.42.42.5(pid=5273): stderr: | 20221209070611378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070611378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070611378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070611379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070611379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070611379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070611379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:13.221901 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5273): Process ended prematurely: osmo-stp_10.42.42.5(pid=5273) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5273)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:06:13.231796 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:06:13.260107 run osmo-hlr_10.42.42.2(pid=5270): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5270)] 07:06:13.311078 run osmo-hlr_10.42.42.2(pid=5270): stdout: | (launched: 2022-12-09_07:06:10.137677) 07:06:13.363641 run osmo-hlr_10.42.42.2(pid=5270): stderr: | 20221209070610337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070610337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070610337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070610337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070610337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070610338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070610350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070610359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070610359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070610359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:13.436569 run osmo-msc_10.42.42.6(pid=5276): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5276)] 07:06:13.487215 run osmo-msc_10.42.42.6(pid=5276): stdout: | (launched: 2022-12-09_07:06:12.257487) 07:06:13.539362 run osmo-msc_10.42.42.6(pid=5276): stderr: | 20221209070612581 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070612581 DLGLOBAL DEBUG validating counter group 0x7f20ab743c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070612581 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070612581 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070612581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070612582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070612583 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070612584 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070612584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070612584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:13.591831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5269): Terminating (SIGTERM) 07:06:13.633782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5272): Terminating (SIGTERM) 07:06:13.675984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5275): Terminating (SIGTERM) 07:06:13.718784 --- ParallelTerminationStrategy: PID 5269 died... 07:06:13.739128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5269): Terminated: ok {rc=0} 07:06:13.786031 --- ParallelTerminationStrategy: PID 5272 died... 07:06:13.805922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5272): Terminated: ok {rc=0} 07:06:13.852639 --- ParallelTerminationStrategy: PID 5275 died... 07:06:13.872667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5275): Terminated: ok {rc=0} 07:06:13.962853 bus /sierra_3: Setting Powered False 07:06:15.064591 bus /sierra_3: Setting Powered False 07:06:16.183647 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:06:17.335907 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:17.348359 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:06:17.407224 tst mo_mt_call_osmux.py: using LAC 19767 07:06:17.539717 tst mo_mt_call_osmux.py: using RAC 132 07:06:17.670460 tst mo_mt_call_osmux.py: using CellId 19767 07:06:17.794380 tst mo_mt_call_osmux.py: using BVCI 19768 07:06:17.909614 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:17.920855 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:17.932130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:17.943321 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:17.954874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:06:17.966421 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:06:18.090162 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:06:18.210717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:18.698671 run create_hlr_db(pid=5278): Launched 07:06:18.818047 bus /sierra_2: Setting Powered False 07:06:19.880032 run create_hlr_db(pid=5278): Terminated: ok {rc=0} 07:06:20.339122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5280): Launched 07:06:20.675967 run osmo-hlr_10.42.42.2(pid=5281): Launched 07:06:20.803601 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:21.381281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5283): Launched 07:06:21.718086 run osmo-stp_10.42.42.5(pid=5284): Launched 07:06:21.845324 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:22.457506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5286): Launched 07:06:22.792834 run osmo-msc_10.42.42.6(pid=5287): Launched 07:06:22.979322 run osmo-stp_10.42.42.5(pid=5284): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5284)] 07:06:23.119630 run osmo-stp_10.42.42.5(pid=5284): stdout: | (launched: 2022-12-09_07:06:21.654892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:23.259907 run osmo-stp_10.42.42.5(pid=5284): stderr: | 20221209070621847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070621847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070621848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070621848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070621848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070621849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070621849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:23.398951 run osmo-stp_10.42.42.5(pid=5284): stdout: | (launched: 2022-12-09_07:06:21.654892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:23.531684 run osmo-stp_10.42.42.5(pid=5284): stderr: | 20221209070621847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070621847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070621848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070621848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070621848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070621849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070621849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:23.690824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5284): Process ended prematurely: osmo-stp_10.42.42.5(pid=5284) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5284)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:06:23.700413 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:06:23.728319 run osmo-hlr_10.42.42.2(pid=5281): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5281)] 07:06:23.778660 run osmo-hlr_10.42.42.2(pid=5281): stdout: | (launched: 2022-12-09_07:06:20.613317) 07:06:23.830875 run osmo-hlr_10.42.42.2(pid=5281): stderr: | 20221209070620812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070620812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070620812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070620812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070620812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070620813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070620824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070620833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070620834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070620834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:23.903449 run osmo-msc_10.42.42.6(pid=5287): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5287)] 07:06:23.954196 run osmo-msc_10.42.42.6(pid=5287): stdout: | (launched: 2022-12-09_07:06:22.730005) 07:06:24.006362 run osmo-msc_10.42.42.6(pid=5287): stderr: | 20221209070623052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070623052 DLGLOBAL DEBUG validating counter group 0x7f28e0c63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070623052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070623053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070623053 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070623053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070623055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070623055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070623055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070623055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:24.059090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5280): Terminating (SIGTERM) 07:06:24.101311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5283): Terminating (SIGTERM) 07:06:24.143914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5286): Terminating (SIGTERM) 07:06:24.186476 --- ParallelTerminationStrategy: PID 5280 died... 07:06:24.206222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5280): Terminated: ok {rc=0} 07:06:24.253338 --- ParallelTerminationStrategy: PID 5283 died... 07:06:24.273388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5283): Terminated: ok {rc=0} 07:06:24.320164 --- ParallelTerminationStrategy: PID 5286 died... 07:06:24.340005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5286): Terminated: ok {rc=0} 07:06:24.429079 bus /sierra_3: Setting Powered False 07:06:25.527992 bus /sierra_3: Setting Powered False 07:06:26.647361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:06:27.882374 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:27.888808 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:06:27.909668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:06:27.937631 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:06:27.991979 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:06:28.014680 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:06:28.042741 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:06:28.591869 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:06:28.646207 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:28.658138 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:06:28.719541 tst mo_mt_call.py: using LAC 19768 07:06:28.850932 tst mo_mt_call.py: using RAC 133 07:06:28.986581 tst mo_mt_call.py: using CellId 19768 07:06:29.118380 tst mo_mt_call.py: using BVCI 19769 07:06:29.240184 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:29.251927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:29.263432 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:29.274994 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:29.286513 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:29.298029 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:06:29.417488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:06:29.540089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:30.063189 run create_hlr_db(pid=5292): Launched 07:06:30.199388 bus /sierra_2: Setting Powered False 07:06:31.268875 run create_hlr_db(pid=5292): Terminated: ok {rc=0} 07:06:31.787775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5294): Launched 07:06:32.145082 run osmo-hlr_10.42.42.2(pid=5295): Launched 07:06:32.268121 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:32.823805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5297): Launched 07:06:33.137404 run osmo-stp_10.42.42.5(pid=5298): Launched 07:06:33.256042 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:33.821368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5300): Launched 07:06:34.135434 run osmo-msc_10.42.42.6(pid=5301): Launched 07:06:34.310912 run osmo-stp_10.42.42.5(pid=5298): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5298)] 07:06:34.443070 run osmo-stp_10.42.42.5(pid=5298): stdout: | (launched: 2022-12-09_07:06:33.078109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:34.574346 run osmo-stp_10.42.42.5(pid=5298): stderr: | 20221209070633249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070633249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070633250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070633250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070633251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070633251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070633251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:34.703956 run osmo-stp_10.42.42.5(pid=5298): stdout: | (launched: 2022-12-09_07:06:33.078109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:34.828404 run osmo-stp_10.42.42.5(pid=5298): stderr: | 20221209070633249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070633249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070633250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070633250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070633251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070633251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070633251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:34.977161 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5298): Process ended prematurely: osmo-stp_10.42.42.5(pid=5298) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5298)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:06:34.986067 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:06:35.012637 run osmo-hlr_10.42.42.2(pid=5295): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5295)] 07:06:35.061233 run osmo-hlr_10.42.42.2(pid=5295): stdout: | (launched: 2022-12-09_07:06:32.080394) 07:06:35.111187 run osmo-hlr_10.42.42.2(pid=5295): stderr: | 20221209070632266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070632267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070632267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070632267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070632267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070632267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070632279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070632287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070632288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070632288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:35.181295 run osmo-msc_10.42.42.6(pid=5301): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5301)] 07:06:35.229419 run osmo-msc_10.42.42.6(pid=5301): stdout: | (launched: 2022-12-09_07:06:34.076008) 07:06:35.279278 run osmo-msc_10.42.42.6(pid=5301): stderr: | 20221209070634349 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070634349 DLGLOBAL DEBUG validating counter group 0x7f372ec55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070634349 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070634350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070634350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070634350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070634352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070634352 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070634352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070634352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:35.329198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5294): Terminating (SIGTERM) 07:06:35.369412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5297): Terminating (SIGTERM) 07:06:35.409754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5300): Terminating (SIGTERM) 07:06:35.450345 --- ParallelTerminationStrategy: PID 5294 died... 07:06:35.470017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5294): Terminated: ok {rc=0} 07:06:35.515081 --- ParallelTerminationStrategy: PID 5297 died... 07:06:35.533860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5297): Terminated: ok {rc=0} 07:06:35.579089 --- ParallelTerminationStrategy: PID 5300 died... 07:06:35.597971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5300): Terminated: ok {rc=0} 07:06:35.685429 bus /sierra_3: Setting Powered False 07:06:36.785167 bus /sierra_3: Setting Powered False 07:06:37.902032 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:06:39.051320 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:39.063268 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:06:39.121084 tst mo_mt_call_osmux.py: using LAC 19769 07:06:39.248066 tst mo_mt_call_osmux.py: using RAC 134 07:06:39.371091 tst mo_mt_call_osmux.py: using CellId 19769 07:06:39.493931 tst mo_mt_call_osmux.py: using BVCI 19770 07:06:39.609155 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:39.620339 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:39.631383 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:39.642675 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:39.654192 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:06:39.665571 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:06:39.788318 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:06:39.911817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:40.399275 run create_hlr_db(pid=5303): Launched 07:06:40.517708 bus /sierra_2: Setting Powered False 07:06:41.579742 run create_hlr_db(pid=5303): Terminated: ok {rc=0} 07:06:42.015653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5305): Launched 07:06:42.330685 run osmo-hlr_10.42.42.2(pid=5306): Launched 07:06:42.450838 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:43.002480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5308): Launched 07:06:43.315790 run osmo-stp_10.42.42.5(pid=5309): Launched 07:06:43.435338 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:44.000289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5311): Launched 07:06:44.314628 run osmo-msc_10.42.42.6(pid=5312): Launched 07:06:44.489487 run osmo-stp_10.42.42.5(pid=5309): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5309)] 07:06:44.631409 run osmo-stp_10.42.42.5(pid=5309): stdout: | (launched: 2022-12-09_07:06:43.256676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:44.775652 run osmo-stp_10.42.42.5(pid=5309): stderr: | 20221209070643424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070643425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070643425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070643425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070643426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070643426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070643426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:44.915869 run osmo-stp_10.42.42.5(pid=5309): stdout: | (launched: 2022-12-09_07:06:43.256676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:45.049878 run osmo-stp_10.42.42.5(pid=5309): stderr: | 20221209070643424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070643425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070643425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070643425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070643426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070643426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070643426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:45.209966 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5309): Process ended prematurely: osmo-stp_10.42.42.5(pid=5309) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5309)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:06:45.219523 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:06:45.247852 run osmo-hlr_10.42.42.2(pid=5306): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5306)] 07:06:45.298612 run osmo-hlr_10.42.42.2(pid=5306): stdout: | (launched: 2022-12-09_07:06:42.271192) 07:06:45.351421 run osmo-hlr_10.42.42.2(pid=5306): stderr: | 20221209070642447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070642447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070642447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070642447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070642447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070642447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070642459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070642467 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070642467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070642467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:45.424412 run osmo-msc_10.42.42.6(pid=5312): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5312)] 07:06:45.475198 run osmo-msc_10.42.42.6(pid=5312): stdout: | (launched: 2022-12-09_07:06:44.254795) 07:06:45.527510 run osmo-msc_10.42.42.6(pid=5312): stderr: | 20221209070644528 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070644528 DLGLOBAL DEBUG validating counter group 0x7fcf4b4dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070644528 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070644528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070644528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070644529 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070644530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070644531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070644531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070644531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:45.580397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5305): Terminating (SIGTERM) 07:06:45.622214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5308): Terminating (SIGTERM) 07:06:45.664297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5311): Terminating (SIGTERM) 07:06:45.706734 --- ParallelTerminationStrategy: PID 5305 died... 07:06:45.727159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5305): Terminated: ok {rc=0} 07:06:45.774089 --- ParallelTerminationStrategy: PID 5308 died... 07:06:45.794043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5308): Terminated: ok {rc=0} 07:06:45.846798 --- ParallelTerminationStrategy: PID 5311 died... 07:06:45.867919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5311): Terminated: ok {rc=0} 07:06:45.974217 bus /sierra_3: Setting Powered False 07:06:47.076083 bus /sierra_3: Setting Powered False 07:06:48.194443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:06:49.427261 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:49.433481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:06:49.455219 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:06:49.482373 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:06:49.534909 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:06:49.555748 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:06:49.582950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:06:50.134805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:06:50.185278 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:50.196339 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:06:50.255621 tst mo_mt_call.py: using LAC 19770 07:06:50.377824 tst mo_mt_call.py: using RAC 135 07:06:50.501089 tst mo_mt_call.py: using CellId 19770 07:06:50.622704 tst mo_mt_call.py: using BVCI 19771 07:06:50.738162 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:50.749419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:50.760293 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:50.771440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:50.782741 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:50.794000 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:06:50.915155 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:06:51.038245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:51.560878 run create_hlr_db(pid=5317): Launched 07:06:51.697700 bus /sierra_2: Setting Powered False 07:06:52.759999 run create_hlr_db(pid=5317): Terminated: ok {rc=0} 07:06:53.206970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Launched 07:06:53.520491 run osmo-hlr_10.42.42.2(pid=5320): Launched 07:06:53.639385 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:54.191390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Launched 07:06:54.506875 run osmo-stp_10.42.42.5(pid=5323): Launched 07:06:54.626138 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:55.192733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5325): Launched 07:06:55.506877 run osmo-msc_10.42.42.6(pid=5326): Launched 07:06:55.681795 run osmo-stp_10.42.42.5(pid=5323): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] 07:06:55.815025 run osmo-stp_10.42.42.5(pid=5323): stdout: | (launched: 2022-12-09_07:06:54.446748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:55.946428 run osmo-stp_10.42.42.5(pid=5323): stderr: | 20221209070654615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070654616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070654616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070654616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070654617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070654617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070654617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:56.076411 run osmo-stp_10.42.42.5(pid=5323): stdout: | (launched: 2022-12-09_07:06:54.446748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:56.200942 run osmo-stp_10.42.42.5(pid=5323): stderr: | 20221209070654615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070654616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070654616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070654616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070654617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070654617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070654617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:56.350034 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5323): Process ended prematurely: osmo-stp_10.42.42.5(pid=5323) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:06:56.359082 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:06:56.386626 run osmo-hlr_10.42.42.2(pid=5320): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5320)] 07:06:56.435807 run osmo-hlr_10.42.42.2(pid=5320): stdout: | (launched: 2022-12-09_07:06:53.461646) 07:06:56.486319 run osmo-hlr_10.42.42.2(pid=5320): stderr: | 20221209070653636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070653637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070653637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070653637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070653637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070653637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070653649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070653657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070653658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070653658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:56.556327 run osmo-msc_10.42.42.6(pid=5326): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5326)] 07:06:56.604870 run osmo-msc_10.42.42.6(pid=5326): stdout: | (launched: 2022-12-09_07:06:55.447212) 07:06:56.655260 run osmo-msc_10.42.42.6(pid=5326): stderr: | 20221209070655718 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070655718 DLGLOBAL DEBUG validating counter group 0x7f5cddd98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070655718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070655718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070655719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070655719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070655720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070655721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070655721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070655721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:56.706518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Terminating (SIGTERM) 07:06:56.746925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Terminating (SIGTERM) 07:06:56.787600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5325): Terminating (SIGTERM) 07:06:56.828475 --- ParallelTerminationStrategy: PID 5319 died... 07:06:56.847858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Terminated: ok {rc=0} 07:06:56.893187 --- ParallelTerminationStrategy: PID 5322 died... 07:06:56.912071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Terminated: ok {rc=0} 07:06:56.956614 --- ParallelTerminationStrategy: PID 5325 died... 07:06:56.975976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5325): Terminated: ok {rc=0} 07:06:57.061251 bus /sierra_3: Setting Powered False 07:06:58.160029 bus /sierra_3: Setting Powered False 07:06:59.276414 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:07:00.422783 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:07:00.435036 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:07:00.492452 tst mo_mt_call_osmux.py: using LAC 19771 07:07:00.614664 tst mo_mt_call_osmux.py: using RAC 136 07:07:00.743124 tst mo_mt_call_osmux.py: using CellId 19771 07:07:00.893319 tst mo_mt_call_osmux.py: using BVCI 19772 07:07:01.012491 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:07:01.026481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:07:01.038752 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:07:01.052912 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:07:01.066322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:07:01.078615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:07:01.200168 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:07:01.321909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:01.850362 run create_hlr_db(pid=5328): Launched 07:07:02.026726 bus /sierra_2: Setting Powered False 07:07:03.088352 run create_hlr_db(pid=5328): Terminated: ok {rc=0} 07:07:03.526372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5330): Launched 07:07:03.841200 run osmo-hlr_10.42.42.2(pid=5331): Launched 07:07:03.959186 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:04.508854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5333): Launched 07:07:04.823213 run osmo-stp_10.42.42.5(pid=5334): Launched 07:07:04.941176 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:05.504884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5336): Launched 07:07:05.818679 run osmo-msc_10.42.42.6(pid=5337): Launched 07:07:05.992812 run osmo-stp_10.42.42.5(pid=5334): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5334)] 07:07:06.124625 run osmo-stp_10.42.42.5(pid=5334): stdout: | (launched: 2022-12-09_07:07:04.763865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:06.256075 run osmo-stp_10.42.42.5(pid=5334): stderr: | 20221209070704937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070704937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070704938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070704938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070704939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070704939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070704939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:06.386312 run osmo-stp_10.42.42.5(pid=5334): stdout: | (launched: 2022-12-09_07:07:04.763865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:06.511429 run osmo-stp_10.42.42.5(pid=5334): stderr: | 20221209070704937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070704937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070704938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070704938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070704939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070704939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070704939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:06.660532 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5334): Process ended prematurely: osmo-stp_10.42.42.5(pid=5334) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5334)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:07:06.669741 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:07:06.696689 run osmo-hlr_10.42.42.2(pid=5331): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5331)] 07:07:06.745241 run osmo-hlr_10.42.42.2(pid=5331): stdout: | (launched: 2022-12-09_07:07:03.781572) 07:07:06.795154 run osmo-hlr_10.42.42.2(pid=5331): stderr: | 20221209070703961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070703961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070703961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070703961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070703961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070703961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070703972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070703981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070703981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070703981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:06.864554 run osmo-msc_10.42.42.6(pid=5337): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5337)] 07:07:06.912724 run osmo-msc_10.42.42.6(pid=5337): stdout: | (launched: 2022-12-09_07:07:05.759279) 07:07:06.962487 run osmo-msc_10.42.42.6(pid=5337): stderr: | 20221209070706033 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070706033 DLGLOBAL DEBUG validating counter group 0x7feef52fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070706034 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070706034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070706034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070706034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070706036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070706036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070706036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070706036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:07.012810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5330): Terminating (SIGTERM) 07:07:07.053001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5333): Terminating (SIGTERM) 07:07:07.092988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5336): Terminating (SIGTERM) 07:07:07.133264 --- ParallelTerminationStrategy: PID 5330 died... 07:07:07.152461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5330): Terminated: ok {rc=0} 07:07:07.196929 --- ParallelTerminationStrategy: PID 5333 died... 07:07:07.215876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5333): Terminated: ok {rc=0} 07:07:07.260789 --- ParallelTerminationStrategy: PID 5336 died... 07:07:07.280001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5336): Terminated: ok {rc=0} 07:07:07.363864 bus /sierra_3: Setting Powered False 07:07:08.462019 bus /sierra_3: Setting Powered False 07:07:09.578577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:07:10.814660 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:10.821265 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:07:10.842742 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:07:10.870173 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:07:10.923976 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:07:10.945997 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:07:10.973405 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:07:11.522143 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:07:11.573211 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:11.584401 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:07:11.642477 tst mo_mt_call.py: using LAC 19772 07:07:11.765904 tst mo_mt_call.py: using RAC 137 07:07:11.889373 tst mo_mt_call.py: using CellId 19772 07:07:12.013379 tst mo_mt_call.py: using BVCI 19773 07:07:12.128717 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:12.139968 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:12.150958 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:12.162179 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:12.173432 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:12.184713 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:07:12.306550 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:07:12.432093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:12.955656 run create_hlr_db(pid=5342): Launched 07:07:13.093024 bus /sierra_2: Setting Powered False 07:07:14.154414 run create_hlr_db(pid=5342): Terminated: ok {rc=0} 07:07:14.604146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Launched 07:07:14.918590 run osmo-hlr_10.42.42.2(pid=5345): Launched 07:07:15.037605 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:15.576342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Launched 07:07:15.930263 run osmo-stp_10.42.42.5(pid=5348): Launched 07:07:16.091734 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:16.843449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5350): Launched 07:07:17.190735 run osmo-msc_10.42.42.6(pid=5351): Launched 07:07:17.484859 run osmo-stp_10.42.42.5(pid=5348): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] 07:07:17.635640 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-09_07:07:15.838923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:17.779172 run osmo-stp_10.42.42.5(pid=5348): stderr: | 20221209070716183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070716183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070716184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070716185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070716186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070716186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070716187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:17.919693 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-09_07:07:15.838923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:18.054260 run osmo-stp_10.42.42.5(pid=5348): stderr: | 20221209070716183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070716183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070716184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070716185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070716186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070716186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070716187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:18.214999 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:07:18.224837 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 07:07:18.253494 run osmo-hlr_10.42.42.2(pid=5345): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5345)] 07:07:18.305148 run osmo-hlr_10.42.42.2(pid=5345): stdout: | (launched: 2022-12-09_07:07:14.859282) 07:07:18.358201 run osmo-hlr_10.42.42.2(pid=5345): stderr: | 20221209070715034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070715035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070715035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070715035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070715035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070715035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070715048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070715058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070715058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070715058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:18.431943 run osmo-msc_10.42.42.6(pid=5351): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5351)] 07:07:18.483704 run osmo-msc_10.42.42.6(pid=5351): stdout: | (launched: 2022-12-09_07:07:17.126100) 07:07:18.536670 run osmo-msc_10.42.42.6(pid=5351): stderr: | 20221209070717491 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070717492 DLGLOBAL DEBUG validating counter group 0x7f7903780c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070717492 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070717492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070717492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070717492 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070717494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070717494 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070717494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070717495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:18.590454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminating (SIGTERM) 07:07:18.633153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminating (SIGTERM) 07:07:18.675980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5350): Terminating (SIGTERM) 07:07:18.719116 --- ParallelTerminationStrategy: PID 5344 died... 07:07:18.739556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminated: ok {rc=0} 07:07:18.787427 --- ParallelTerminationStrategy: PID 5347 died... 07:07:18.807358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminated: ok {rc=0} 07:07:18.854523 --- ParallelTerminationStrategy: PID 5350 died... 07:07:18.874624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5350): Terminated: ok {rc=0} 07:07:18.964008 bus /sierra_3: Setting Powered False 07:07:20.064388 bus /sierra_3: Setting Powered False 07:07:21.181102 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:07:22.333531 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:22.346085 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:07:22.410364 tst mo_mt_call_osmux.py: using LAC 19773 07:07:22.540936 tst mo_mt_call_osmux.py: using RAC 138 07:07:22.671837 tst mo_mt_call_osmux.py: using CellId 19773 07:07:22.805563 tst mo_mt_call_osmux.py: using BVCI 19774 07:07:22.928922 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:22.940920 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:22.952473 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:22.963998 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:22.975584 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:07:22.987330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:07:23.110397 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:07:23.231144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:23.719722 run create_hlr_db(pid=5353): Launched 07:07:23.839774 bus /sierra_2: Setting Powered False 07:07:24.902572 run create_hlr_db(pid=5353): Terminated: ok {rc=0} 07:07:25.341135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5355): Launched 07:07:25.656234 run osmo-hlr_10.42.42.2(pid=5356): Launched 07:07:25.775521 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:26.327681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5358): Launched 07:07:26.642468 run osmo-stp_10.42.42.5(pid=5359): Launched 07:07:26.760774 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:27.326795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5361): Launched 07:07:27.640857 run osmo-msc_10.42.42.6(pid=5362): Launched 07:07:27.815008 run osmo-stp_10.42.42.5(pid=5359): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5359)] 07:07:27.946829 run osmo-stp_10.42.42.5(pid=5359): stdout: | (launched: 2022-12-09_07:07:26.582675) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:28.077825 run osmo-stp_10.42.42.5(pid=5359): stderr: | 20221209070726756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070726756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070726756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070726757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070726757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070726757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070726757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:28.207263 run osmo-stp_10.42.42.5(pid=5359): stdout: | (launched: 2022-12-09_07:07:26.582675) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:28.330851 run osmo-stp_10.42.42.5(pid=5359): stderr: | 20221209070726756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070726756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070726756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070726757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070726757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070726757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070726757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:28.479133 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5359): Process ended prematurely: osmo-stp_10.42.42.5(pid=5359) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5359)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:07:28.488087 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:07:28.514923 run osmo-hlr_10.42.42.2(pid=5356): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5356)] 07:07:28.563551 run osmo-hlr_10.42.42.2(pid=5356): stdout: | (launched: 2022-12-09_07:07:25.596791) 07:07:28.613301 run osmo-hlr_10.42.42.2(pid=5356): stderr: | 20221209070725774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070725774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070725774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070725774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070725774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070725774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070725786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070725796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070725796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070725796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:28.683254 run osmo-msc_10.42.42.6(pid=5362): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5362)] 07:07:28.731345 run osmo-msc_10.42.42.6(pid=5362): stdout: | (launched: 2022-12-09_07:07:27.581640) 07:07:28.781420 run osmo-msc_10.42.42.6(pid=5362): stderr: | 20221209070727854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070727854 DLGLOBAL DEBUG validating counter group 0x7fd811b92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070727854 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070727854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070727854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070727855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070727856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070727857 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070727857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070727857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:28.831535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5355): Terminating (SIGTERM) 07:07:28.871118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5358): Terminating (SIGTERM) 07:07:28.911023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5361): Terminating (SIGTERM) 07:07:28.951080 --- ParallelTerminationStrategy: PID 5355 died... 07:07:28.970256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5355): Terminated: ok {rc=0} 07:07:29.014681 --- ParallelTerminationStrategy: PID 5358 died... 07:07:29.033319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5358): Terminated: ok {rc=0} 07:07:29.077887 --- ParallelTerminationStrategy: PID 5361 died... 07:07:29.096498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5361): Terminated: ok {rc=0} 07:07:29.182748 bus /sierra_3: Setting Powered False 07:07:30.280822 bus /sierra_3: Setting Powered False 07:07:31.401323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:07:32.636575 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:32.644326 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:07:32.666019 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:07:32.693231 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:07:32.745644 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:07:32.766395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:07:32.793305 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:07:33.344013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:07:33.394499 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:33.405714 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:07:33.462433 tst mo_mt_call.py: using LAC 19774 07:07:33.585770 tst mo_mt_call.py: using RAC 139 07:07:33.708230 tst mo_mt_call.py: using CellId 19774 07:07:33.828087 tst mo_mt_call.py: using BVCI 19775 07:07:33.940864 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:33.952183 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:33.963163 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:33.974399 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:33.985757 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:33.997051 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:07:34.120294 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:07:34.240039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:34.727074 run create_hlr_db(pid=5367): Launched 07:07:34.862346 bus /sierra_2: Setting Powered False 07:07:35.928488 run create_hlr_db(pid=5367): Terminated: ok {rc=0} 07:07:36.397640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5369): Launched 07:07:36.735171 run osmo-hlr_10.42.42.2(pid=5370): Launched 07:07:36.862120 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:37.444333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5372): Launched 07:07:37.781619 run osmo-stp_10.42.42.5(pid=5373): Launched 07:07:37.908381 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:38.516264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5375): Launched 07:07:38.834504 run osmo-msc_10.42.42.6(pid=5376): Launched 07:07:39.010591 run osmo-stp_10.42.42.5(pid=5373): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5373)] 07:07:39.143976 run osmo-stp_10.42.42.5(pid=5373): stdout: | (launched: 2022-12-09_07:07:37.718432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:39.275814 run osmo-stp_10.42.42.5(pid=5373): stderr: | 20221209070737913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070737914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070737914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070737914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070737915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070737915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070737915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:39.406124 run osmo-stp_10.42.42.5(pid=5373): stdout: | (launched: 2022-12-09_07:07:37.718432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:39.530748 run osmo-stp_10.42.42.5(pid=5373): stderr: | 20221209070737913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070737914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070737914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070737914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070737915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070737915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070737915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:39.680246 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5373): Process ended prematurely: osmo-stp_10.42.42.5(pid=5373) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5373)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:07:39.689342 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:07:39.716361 run osmo-hlr_10.42.42.2(pid=5370): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5370)] 07:07:39.765300 run osmo-hlr_10.42.42.2(pid=5370): stdout: | (launched: 2022-12-09_07:07:36.671346) 07:07:39.815501 run osmo-hlr_10.42.42.2(pid=5370): stderr: | 20221209070736871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070736871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070736871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070736871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070736871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070736871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070736884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070736894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070736894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070736895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:39.885634 run osmo-msc_10.42.42.6(pid=5376): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5376)] 07:07:39.934133 run osmo-msc_10.42.42.6(pid=5376): stdout: | (launched: 2022-12-09_07:07:38.775040) 07:07:39.984383 run osmo-msc_10.42.42.6(pid=5376): stderr: | 20221209070739050 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070739050 DLGLOBAL DEBUG validating counter group 0x7f5132943c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070739050 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070739050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070739050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070739050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070739052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070739052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070739053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070739053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:40.035023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5369): Terminating (SIGTERM) 07:07:40.075235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5372): Terminating (SIGTERM) 07:07:40.115816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5375): Terminating (SIGTERM) 07:07:40.156688 --- ParallelTerminationStrategy: PID 5369 died... 07:07:40.176107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5369): Terminated: ok {rc=0} 07:07:40.221310 --- ParallelTerminationStrategy: PID 5372 died... 07:07:40.240234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5372): Terminated: ok {rc=0} 07:07:40.285475 --- ParallelTerminationStrategy: PID 5375 died... 07:07:40.304379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5375): Terminated: ok {rc=0} 07:07:40.392190 bus /sierra_3: Setting Powered False 07:07:41.493809 bus /sierra_3: Setting Powered False 07:07:42.612433 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:07:43.761725 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:43.773834 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:07:43.835668 tst mo_mt_call_osmux.py: using LAC 19775 07:07:43.966748 tst mo_mt_call_osmux.py: using RAC 140 07:07:44.095905 tst mo_mt_call_osmux.py: using CellId 19775 07:07:44.220021 tst mo_mt_call_osmux.py: using BVCI 19776 07:07:44.344562 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:44.356544 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:44.368280 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:44.379795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:44.391281 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:07:44.402861 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:07:44.526977 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:07:44.650275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:45.175575 run create_hlr_db(pid=5378): Launched 07:07:45.311226 bus /sierra_2: Setting Powered False 07:07:46.393938 run create_hlr_db(pid=5378): Terminated: ok {rc=0} 07:07:46.905703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5380): Launched 07:07:47.255126 run osmo-hlr_10.42.42.2(pid=5381): Launched 07:07:47.383600 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:47.968309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5383): Launched 07:07:48.307049 run osmo-stp_10.42.42.5(pid=5384): Launched 07:07:48.433994 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:49.041354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5386): Launched 07:07:49.378136 run osmo-msc_10.42.42.6(pid=5387): Launched 07:07:49.565878 run osmo-stp_10.42.42.5(pid=5384): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5384)] 07:07:49.706195 run osmo-stp_10.42.42.5(pid=5384): stdout: | (launched: 2022-12-09_07:07:48.243712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:49.846496 run osmo-stp_10.42.42.5(pid=5384): stderr: | 20221209070748438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070748438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070748438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070748439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070748439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070748439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070748439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:49.986359 run osmo-stp_10.42.42.5(pid=5384): stdout: | (launched: 2022-12-09_07:07:48.243712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:50.119681 run osmo-stp_10.42.42.5(pid=5384): stderr: | 20221209070748438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070748438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070748438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070748439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070748439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070748439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070748439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:50.279516 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5384): Process ended prematurely: osmo-stp_10.42.42.5(pid=5384) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5384)] [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:07:50.289035 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:07:50.317203 run osmo-hlr_10.42.42.2(pid=5381): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5381)] 07:07:50.367187 run osmo-hlr_10.42.42.2(pid=5381): stdout: | (launched: 2022-12-09_07:07:47.191843) 07:07:50.419026 run osmo-hlr_10.42.42.2(pid=5381): stderr: | 20221209070747392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070747392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070747392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070747392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070747392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070747392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070747404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070747413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070747413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070747413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:50.491368 run osmo-msc_10.42.42.6(pid=5387): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5387)] 07:07:50.541927 run osmo-msc_10.42.42.6(pid=5387): stdout: | (launched: 2022-12-09_07:07:49.314755) 07:07:50.593837 run osmo-msc_10.42.42.6(pid=5387): stderr: | 20221209070749640 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070749640 DLGLOBAL DEBUG validating counter group 0x7f4ee5f4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070749640 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070749640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070749640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070749641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070749643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070749643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070749643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070749643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:50.646251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5380): Terminating (SIGTERM) 07:07:50.687988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5383): Terminating (SIGTERM) 07:07:50.729980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5386): Terminating (SIGTERM) 07:07:50.772348 --- ParallelTerminationStrategy: PID 5380 died... 07:07:50.792646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5380): Terminated: ok {rc=0} 07:07:50.840179 --- ParallelTerminationStrategy: PID 5383 died... 07:07:50.860251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5383): Terminated: ok {rc=0} 07:07:50.907253 --- ParallelTerminationStrategy: PID 5386 died... 07:07:50.927317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5386): Terminated: ok {rc=0} 07:07:51.017128 bus /sierra_3: Setting Powered False 07:07:52.116209 bus /sierra_3: Setting Powered False 07:07:53.234422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:07:54.477698 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:54.485365 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:07:54.508468 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:07:54.536864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:07:54.592167 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:07:54.613639 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:07:54.641675 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:07:55.190718 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:07:55.242163 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:55.253572 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:07:55.309952 tst mo_mt_call.py: using LAC 19776 07:07:55.432029 tst mo_mt_call.py: using RAC 141 07:07:55.555069 tst mo_mt_call.py: using CellId 19776 07:07:55.678036 tst mo_mt_call.py: using BVCI 19777 07:07:55.793330 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:55.804480 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:55.815527 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:55.826969 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:55.838518 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:55.850115 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:07:55.973308 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:07:56.093124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:56.615366 run create_hlr_db(pid=5392): Launched 07:07:56.750466 bus /sierra_2: Setting Powered False 07:07:57.816447 run create_hlr_db(pid=5392): Terminated: ok {rc=0} 07:07:58.263378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Launched 07:07:58.578122 run osmo-hlr_10.42.42.2(pid=5395): Launched 07:07:58.697770 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:59.245196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Launched 07:07:59.559687 run osmo-stp_10.42.42.5(pid=5398): Launched 07:07:59.678834 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:00.244863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5400): Launched 07:08:00.558615 run osmo-msc_10.42.42.6(pid=5401): Launched 07:08:00.733328 run osmo-stp_10.42.42.5(pid=5398): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] 07:08:00.926893 run osmo-stp_10.42.42.5(pid=5398): stdout: | (launched: 2022-12-09_07:07:59.500103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:01.070416 run osmo-stp_10.42.42.5(pid=5398): stderr: | 20221209070759672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070759672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070759673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070759673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070759674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070759674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070759674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:01.214358 run osmo-stp_10.42.42.5(pid=5398): stdout: | (launched: 2022-12-09_07:07:59.500103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:01.353147 run osmo-stp_10.42.42.5(pid=5398): stderr: | 20221209070759672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070759672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070759673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070759673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070759674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070759674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070759674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:01.524290 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5398): Process ended prematurely: osmo-stp_10.42.42.5(pid=5398) [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:08:01.539533 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:08:01.577171 run osmo-hlr_10.42.42.2(pid=5395): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5395)] 07:08:01.637569 run osmo-hlr_10.42.42.2(pid=5395): stdout: | (launched: 2022-12-09_07:07:58.518886) 07:08:01.692134 run osmo-hlr_10.42.42.2(pid=5395): stderr: | 20221209070758695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070758695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070758695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070758695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070758695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070758695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070758707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070758718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070758718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070758718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:01.774286 run osmo-msc_10.42.42.6(pid=5401): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5401)] 07:08:01.834668 run osmo-msc_10.42.42.6(pid=5401): stdout: | (launched: 2022-12-09_07:08:00.499151) 07:08:01.900594 run osmo-msc_10.42.42.6(pid=5401): stderr: | 20221209070800770 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070800770 DLGLOBAL DEBUG validating counter group 0x7f361a13dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070800770 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070800770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070800770 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070800771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070800772 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070800773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070800773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070800773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:01.961790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Terminating (SIGTERM) 07:08:02.010572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Terminating (SIGTERM) 07:08:02.071291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5400): Terminating (SIGTERM) 07:08:02.118390 --- ParallelTerminationStrategy: PID 5394 died... 07:08:02.139043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Terminated: ok {rc=0} 07:08:02.188159 --- ParallelTerminationStrategy: PID 5397 died... 07:08:02.208725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Terminated: ok {rc=0} 07:08:02.257000 --- ParallelTerminationStrategy: PID 5400 died... 07:08:02.277527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5400): Terminated: ok {rc=0} 07:08:02.384543 bus /sierra_3: Setting Powered False 07:08:03.526754 bus /sierra_3: Setting Powered False 07:08:04.667114 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:08:05.822148 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:08:05.834812 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:08:05.893831 tst mo_mt_call_osmux.py: using LAC 19777 07:08:06.026442 tst mo_mt_call_osmux.py: using RAC 142 07:08:06.158190 tst mo_mt_call_osmux.py: using CellId 19777 07:08:06.292796 tst mo_mt_call_osmux.py: using BVCI 19778 07:08:06.419544 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:08:06.432407 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:08:06.445049 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:08:06.457612 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:08:06.470181 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:08:06.483042 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:08:06.608312 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:08:06.735743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:07.271272 run create_hlr_db(pid=5674): Launched 07:08:07.442706 bus /sierra_2: Setting Powered False 07:08:08.510770 run create_hlr_db(pid=5674): Terminated: ok {rc=0} 07:08:08.995059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5676): Launched 07:08:09.352015 run osmo-hlr_10.42.42.2(pid=5677): Launched 07:08:09.608418 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:10.224704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5679): Launched 07:08:10.583784 run osmo-stp_10.42.42.5(pid=5680): Launched 07:08:10.849679 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:11.548443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5682): Launched 07:08:11.885275 run osmo-msc_10.42.42.6(pid=5683): Launched 07:08:12.245380 run osmo-stp_10.42.42.5(pid=5680): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5680)] 07:08:12.526465 run osmo-stp_10.42.42.5(pid=5680): stdout: | (launched: 2022-12-09_07:08:10.520279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:12.821432 run osmo-stp_10.42.42.5(pid=5680): stderr: | 20221209070810817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070810817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070810817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070810818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070810818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070810818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070810818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:12.961825 run osmo-stp_10.42.42.5(pid=5680): stdout: | (launched: 2022-12-09_07:08:10.520279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:13.091908 run osmo-stp_10.42.42.5(pid=5680): stderr: | 20221209070810817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070810817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070810817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070810818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070810818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070810818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070810818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:13.247077 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5680): Process ended prematurely: osmo-stp_10.42.42.5(pid=5680) [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5680)] [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:08:13.257205 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 07:08:13.288033 run osmo-hlr_10.42.42.2(pid=5677): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5677)] 07:08:13.339992 run osmo-hlr_10.42.42.2(pid=5677): stdout: | (launched: 2022-12-09_07:08:09.287108) 07:08:13.393651 run osmo-hlr_10.42.42.2(pid=5677): stderr: | 20221209070809595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070809595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070809595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070809595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070809595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070809595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070809615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070809623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070809623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070809623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:13.468151 run osmo-msc_10.42.42.6(pid=5683): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5683)] 07:08:13.519834 run osmo-msc_10.42.42.6(pid=5683): stdout: | (launched: 2022-12-09_07:08:11.824248) 07:08:13.573723 run osmo-msc_10.42.42.6(pid=5683): stderr: | 20221209070812412 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070812412 DLGLOBAL DEBUG validating counter group 0x7fccf8ec7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070812412 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070812412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070812417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070812417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070812419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070812419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070812419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070812419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:13.628118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5676): Terminating (SIGTERM) 07:08:13.671324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5679): Terminating (SIGTERM) 07:08:13.715480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5682): Terminating (SIGTERM) 07:08:13.761164 --- ParallelTerminationStrategy: PID 5676 died... 07:08:13.781820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5676): Terminated: ok {rc=0} 07:08:13.831885 --- ParallelTerminationStrategy: PID 5679 died... 07:08:13.852139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5679): Terminated: ok {rc=0} 07:08:13.900749 --- ParallelTerminationStrategy: PID 5682 died... 07:08:13.921141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5682): Terminated: ok {rc=0} 07:08:14.011479 bus /sierra_3: Setting Powered False 07:08:15.112712 bus /sierra_3: Setting Powered False 07:08:16.251108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:08:17.518558 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:08:17.525697 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:08:17.548764 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:08:17.578422 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:08:17.632747 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:08:17.655314 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:08:17.684180 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:08:18.234642 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:08:18.292028 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:18.305080 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:08:18.369387 tst mo_mt_call.py: using LAC 19778 07:08:18.502629 tst mo_mt_call.py: using RAC 143 07:08:18.636683 tst mo_mt_call.py: using CellId 19778 07:08:18.771196 tst mo_mt_call.py: using BVCI 19779 07:08:18.897935 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:18.910490 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:18.924059 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:18.936905 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:18.950069 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:18.962678 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:08:19.092277 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:08:19.220907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:19.762080 run create_hlr_db(pid=5688): Launched 07:08:19.938056 bus /sierra_2: Setting Powered False 07:08:21.006960 run create_hlr_db(pid=5688): Terminated: ok {rc=0} 07:08:21.491114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5690): Launched 07:08:21.852140 run osmo-hlr_10.42.42.2(pid=5691): Launched 07:08:22.110949 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:22.811232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5693): Launched 07:08:23.174192 run osmo-stp_10.42.42.5(pid=5694): Launched 07:08:23.429272 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:24.074392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5697): Launched 07:08:24.390243 run osmo-msc_10.42.42.6(pid=5698): Launched 07:08:24.565225 run osmo-stp_10.42.42.5(pid=5694): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5694)] 07:08:24.697247 run osmo-stp_10.42.42.5(pid=5694): stdout: | (launched: 2022-12-09_07:08:23.109094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:24.841656 run osmo-stp_10.42.42.5(pid=5694): stderr: | 20221209070823414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070823414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070823415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070823415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070823416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070823416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070823416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:24.981509 run osmo-stp_10.42.42.5(pid=5694): stdout: | (launched: 2022-12-09_07:08:23.109094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:25.116211 run osmo-stp_10.42.42.5(pid=5694): stderr: | 20221209070823414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070823414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070823415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070823415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070823416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070823416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070823416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:25.276507 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5694): Process ended prematurely: osmo-stp_10.42.42.5(pid=5694) [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5694)] [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:08:25.286451 tst mo_mt_call.py:8: Test FAILED (7.0 sec) 07:08:25.314899 run osmo-hlr_10.42.42.2(pid=5691): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5691)] 07:08:25.366064 run osmo-hlr_10.42.42.2(pid=5691): stdout: | (launched: 2022-12-09_07:08:21.787787) 07:08:25.418789 run osmo-hlr_10.42.42.2(pid=5691): stderr: | 20221209070822099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070822099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070822099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070822099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070822099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070822100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070822120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070822130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070822131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070822131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:25.492025 run osmo-msc_10.42.42.6(pid=5698): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5698)] 07:08:25.542786 run osmo-msc_10.42.42.6(pid=5698): stdout: | (launched: 2022-12-09_07:08:24.330570) 07:08:25.595363 run osmo-msc_10.42.42.6(pid=5698): stderr: | 20221209070824604 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070824604 DLGLOBAL DEBUG validating counter group 0x7fc259765c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070824605 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070824605 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070824605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070824605 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070824607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070824607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070824607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070824607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:25.647929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5690): Terminating (SIGTERM) 07:08:25.689837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5693): Terminating (SIGTERM) 07:08:25.732068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5697): Terminating (SIGTERM) 07:08:25.775013 --- ParallelTerminationStrategy: PID 5690 died... 07:08:25.795501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5690): Terminated: ok {rc=0} 07:08:25.843016 --- ParallelTerminationStrategy: PID 5693 died... 07:08:25.862931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5693): Terminated: ok {rc=0} 07:08:25.909996 --- ParallelTerminationStrategy: PID 5697 died... 07:08:25.930160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5697): Terminated: ok {rc=0} 07:08:26.020088 bus /sierra_3: Setting Powered False 07:08:27.119400 bus /sierra_3: Setting Powered False 07:08:28.238083 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:08:29.387306 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:29.399240 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:08:29.457966 tst mo_mt_call_osmux.py: using LAC 19779 07:08:29.582163 tst mo_mt_call_osmux.py: using RAC 144 07:08:29.708251 tst mo_mt_call_osmux.py: using CellId 19779 07:08:29.844780 tst mo_mt_call_osmux.py: using BVCI 19780 07:08:29.967168 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:29.979011 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:29.990614 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:30.002178 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:30.013827 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:08:30.025230 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:08:30.143531 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:08:30.266979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:30.792820 run create_hlr_db(pid=5701): Launched 07:08:30.947323 bus /sierra_2: Setting Powered False 07:08:32.032259 run create_hlr_db(pid=5701): Terminated: ok {rc=0} 07:08:32.517178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5703): Launched 07:08:32.858849 run osmo-hlr_10.42.42.2(pid=5704): Launched 07:08:32.989815 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:33.570990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5706): Launched 07:08:33.908556 run osmo-stp_10.42.42.5(pid=5707): Launched 07:08:34.037617 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:34.651514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5709): Launched 07:08:34.993271 run osmo-msc_10.42.42.6(pid=5710): Launched 07:08:35.182927 run osmo-stp_10.42.42.5(pid=5707): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5707)] 07:08:35.328199 run osmo-stp_10.42.42.5(pid=5707): stdout: | (launched: 2022-12-09_07:08:33.845533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:35.469928 run osmo-stp_10.42.42.5(pid=5707): stderr: | 20221209070834040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070834040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070834041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070834041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070834041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070834042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070834042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:35.609810 run osmo-stp_10.42.42.5(pid=5707): stdout: | (launched: 2022-12-09_07:08:33.845533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:35.743755 run osmo-stp_10.42.42.5(pid=5707): stderr: | 20221209070834040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070834040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070834041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070834041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070834041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070834042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070834042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:35.904603 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5707): Process ended prematurely: osmo-stp_10.42.42.5(pid=5707) [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5707)] [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:08:35.914965 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:08:35.943369 run osmo-hlr_10.42.42.2(pid=5704): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5704)] 07:08:35.994798 run osmo-hlr_10.42.42.2(pid=5704): stdout: | (launched: 2022-12-09_07:08:32.795377) 07:08:36.047327 run osmo-hlr_10.42.42.2(pid=5704): stderr: | 20221209070832998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070832998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070832998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070832998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070832998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070832998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070833010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070833019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070833019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070833019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:36.120822 run osmo-msc_10.42.42.6(pid=5710): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5710)] 07:08:36.171833 run osmo-msc_10.42.42.6(pid=5710): stdout: | (launched: 2022-12-09_07:08:34.929244) 07:08:36.224337 run osmo-msc_10.42.42.6(pid=5710): stderr: | 20221209070835255 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070835255 DLGLOBAL DEBUG validating counter group 0x7f3c40449c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070835256 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070835256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070835256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070835256 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070835258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070835258 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070835258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070835258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:36.277177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5703): Terminating (SIGTERM) 07:08:36.319288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5706): Terminating (SIGTERM) 07:08:36.361810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5709): Terminating (SIGTERM) 07:08:36.404421 --- ParallelTerminationStrategy: PID 5703 died... 07:08:36.425142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5703): Terminated: ok {rc=0} 07:08:36.472516 --- ParallelTerminationStrategy: PID 5706 died... 07:08:36.492657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5706): Terminated: ok {rc=0} 07:08:36.539634 --- ParallelTerminationStrategy: PID 5709 died... 07:08:36.559692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5709): Terminated: ok {rc=0} 07:08:36.648280 bus /sierra_3: Setting Powered False 07:08:37.748601 bus /sierra_3: Setting Powered False 07:08:38.867718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:oc2g --------------------------------------------------------------------- 07:08:40.100758 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:08:40.105307 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 07:08:40.126837 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 07:08:40.154357 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 07:08:40.240673 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 07:08:40.261567 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 07:08:40.289255 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 07:08:40.873375 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 07:08:40.878708 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:40.889804 tst emergency:oc2g: Using 1 x bts (candidates: 1) 07:08:40.927972 tst emergency_mo_mt_call.py: using LAC 19780 07:08:41.060067 tst emergency_mo_mt_call.py: using RAC 145 07:08:41.191821 tst emergency_mo_mt_call.py: using CellId 19780 07:08:41.326539 tst emergency_mo_mt_call.py: using BVCI 19781 07:08:41.448124 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:41.459484 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:41.470854 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:41.481923 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:41.493027 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:41.504018 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:08:41.622563 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:08:41.739379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:42.222141 run create_hlr_db(pid=5715): Launched 07:08:42.354102 bus /sierra_2: Setting Powered False 07:08:43.419539 run create_hlr_db(pid=5715): Terminated: ok {rc=0} 07:08:43.883037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5717): Launched 07:08:44.218581 run osmo-hlr_10.42.42.2(pid=5718): Launched 07:08:44.345301 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:44.922385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5720): Launched 07:08:45.257336 run osmo-stp_10.42.42.5(pid=5721): Launched 07:08:45.395810 tst emergency_mo_mt_call.py: using MSISDN 7084 07:08:45.567740 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:46.176138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5723): Launched 07:08:46.508581 run osmo-msc_10.42.42.6(pid=5724): Launched 07:08:47.053809 run osmo-stp_10.42.42.5(pid=5721): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5721)] 07:08:47.330052 run osmo-stp_10.42.42.5(pid=5721): stdout: | (launched: 2022-12-09_07:08:45.194350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:47.469556 run osmo-stp_10.42.42.5(pid=5721): stderr: | 20221209070845389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070845389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070845390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070845390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070845390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070845390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070845391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:47.607804 run osmo-stp_10.42.42.5(pid=5721): stdout: | (launched: 2022-12-09_07:08:45.194350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:47.739917 run osmo-stp_10.42.42.5(pid=5721): stderr: | 20221209070845389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070845389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070845390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070845390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070845390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070845390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070845391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:47.897547 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5721): Process ended prematurely: osmo-stp_10.42.42.5(pid=5721) [trial-2356↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5721)] [trial-2356↪emergency:oc2g↪emergency_mo_mt_call.py:19] 07:08:47.906632 tst emergency_mo_mt_call.py:19: Test FAILED (7.0 sec) 07:08:47.934608 run osmo-hlr_10.42.42.2(pid=5718): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5718)] 07:08:47.985608 run osmo-hlr_10.42.42.2(pid=5718): stdout: | (launched: 2022-12-09_07:08:44.156028) 07:08:48.038243 run osmo-hlr_10.42.42.2(pid=5718): stderr: | 20221209070844355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070844355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070844355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070844355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070844355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070844355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070844367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070844378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070844378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070844378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:48.111104 run osmo-msc_10.42.42.6(pid=5724): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5724)] 07:08:48.162009 run osmo-msc_10.42.42.6(pid=5724): stdout: | (launched: 2022-12-09_07:08:46.447573) 07:08:48.214474 run osmo-msc_10.42.42.6(pid=5724): stderr: | 20221209070847002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070847002 DLGLOBAL DEBUG validating counter group 0x7f5b9be7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070847003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070847004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070847004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070847004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070847011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070847012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070847014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070847014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:48.267039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5717): Terminating (SIGTERM) 07:08:48.308998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5720): Terminating (SIGTERM) 07:08:48.351180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5723): Terminating (SIGTERM) 07:08:48.393714 --- ParallelTerminationStrategy: PID 5717 died... 07:08:48.414147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5717): Terminated: ok {rc=0} 07:08:48.461466 --- ParallelTerminationStrategy: PID 5720 died... 07:08:48.481391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5720): Terminated: ok {rc=0} 07:08:48.528276 --- ParallelTerminationStrategy: PID 5723 died... 07:08:48.548448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5723): Terminated: ok {rc=0} 07:08:48.637275 bus /sierra_3: Setting Powered False 07:08:49.738859 bus /sierra_3: Setting Powered False 07:08:50.857571 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 07:08:51.946461 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:51.958244 tst emergency:oc2g: Using 1 x bts (candidates: 1) 07:08:51.998958 tst emergency_preemptive_call.py: using LAC 19781 07:08:52.119963 tst emergency_preemptive_call.py: using RAC 146 07:08:52.242790 tst emergency_preemptive_call.py: using CellId 19781 07:08:52.365456 tst emergency_preemptive_call.py: using BVCI 19782 07:08:52.486979 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:52.498417 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:52.509717 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:52.520893 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:52.533299 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:08:52.544406 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:08:52.663146 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:08:52.784560 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:08:52.906310 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:08:53.029959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:53.548505 run create_hlr_db(pid=5726): Launched 07:08:53.685388 bus /sierra_2: Setting Powered False 07:08:54.750528 run create_hlr_db(pid=5726): Terminated: ok {rc=0} 07:08:55.192168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5728): Launched 07:08:55.506089 run osmo-hlr_10.42.42.2(pid=5729): Launched 07:08:55.624850 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:56.173404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5731): Launched 07:08:56.485600 run osmo-stp_10.42.42.5(pid=5732): Launched 07:08:56.616326 tst emergency_preemptive_call.py: using MSISDN 7085 07:08:56.782241 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:57.338341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5734): Launched 07:08:57.648624 run osmo-msc_10.42.42.6(pid=5735): Launched 07:08:57.823240 run osmo-stp_10.42.42.5(pid=5732): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5732)] 07:08:57.954219 run osmo-stp_10.42.42.5(pid=5732): stdout: | (launched: 2022-12-09_07:08:56.426575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:58.084734 run osmo-stp_10.42.42.5(pid=5732): stderr: | 20221209070856598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070856598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070856598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070856598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070856599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070856599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070856599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:58.213409 run osmo-stp_10.42.42.5(pid=5732): stdout: | (launched: 2022-12-09_07:08:56.426575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:58.335640 run osmo-stp_10.42.42.5(pid=5732): stderr: | 20221209070856598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070856598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070856598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070856598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070856599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070856599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070856599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:58.482437 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5732): Process ended prematurely: osmo-stp_10.42.42.5(pid=5732) [trial-2356↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5732)] [trial-2356↪emergency:oc2g↪emergency_preemptive_call.py:32] 07:08:58.491119 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 07:08:58.518181 run osmo-hlr_10.42.42.2(pid=5729): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5729)] 07:08:58.566973 run osmo-hlr_10.42.42.2(pid=5729): stdout: | (launched: 2022-12-09_07:08:55.446778) 07:08:58.617247 run osmo-hlr_10.42.42.2(pid=5729): stderr: | 20221209070855624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070855624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070855624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070855624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070855624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070855624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070855636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070855645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070855645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070855645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:58.687327 run osmo-msc_10.42.42.6(pid=5735): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5735)] 07:08:58.735990 run osmo-msc_10.42.42.6(pid=5735): stdout: | (launched: 2022-12-09_07:08:57.589854) 07:08:58.785965 run osmo-msc_10.42.42.6(pid=5735): stderr: | 20221209070857864 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209070857865 DLGLOBAL DEBUG validating counter group 0x7fbabdd3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209070857865 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209070857865 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209070857865 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209070857865 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209070857867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209070857868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209070857868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209070857868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:58.836368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5728): Terminating (SIGTERM) 07:08:58.876474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5731): Terminating (SIGTERM) 07:08:58.916766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5734): Terminating (SIGTERM) 07:08:58.957259 --- ParallelTerminationStrategy: PID 5728 died... 07:08:58.976511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5728): Terminated: ok {rc=0} 07:08:59.021788 --- ParallelTerminationStrategy: PID 5731 died... 07:08:59.040731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5731): Terminated: ok {rc=0} 07:08:59.086267 --- ParallelTerminationStrategy: PID 5734 died... 07:08:59.105412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5734): Terminated: ok {rc=0} 07:08:59.191102 bus /sierra_9: Setting Powered False 07:09:00.290654 bus /sierra_9: Setting Powered False 07:09:01.412554 bus /sierra_8: Setting Powered False 07:09:02.513300 bus /sierra_8: Setting Powered False 07:09:03.630642 bus /sierra_3: Setting Powered False 07:09:04.730757 bus /sierra_3: Setting Powered False 07:09:05.848994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:oc2g --------------------------------------------------------------------- 07:09:07.124201 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:09:07.128916 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 07:09:07.150712 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 07:09:07.191146 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 07:09:07.280463 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 07:09:07.302170 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 07:09:07.342466 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 07:09:07.937949 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 07:09:07.993366 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.004591 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:09:08.042822 tst cs_paging_gprs_active.py: using LAC 19782 07:09:08.165639 tst cs_paging_gprs_active.py: using RAC 147 07:09:08.298856 tst cs_paging_gprs_active.py: using CellId 19782 07:09:08.431825 tst cs_paging_gprs_active.py: using BVCI 19783 07:09:08.554951 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.566088 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.577023 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.588063 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.598894 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.609765 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.621159 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.631979 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:08.643170 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:08.762069 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:08.884815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:09:09.114507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:09.456328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5740): Launched 07:09:09.752491 run iperf3-srv_10.42.42.10(pid=5741): Launched 07:09:09.880578 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:09:10.110050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:10.460942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5742): Launched 07:09:10.748650 run iperf3-srv_10.42.42.10(pid=5743): Launched 07:09:10.871649 tst cs_paging_gprs_active.py:38: start network... 07:09:11.096099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:11.609281 run create_hlr_db(pid=5744): Launched 07:09:11.743612 bus /sierra_2: Setting Powered False 07:09:12.809563 run create_hlr_db(pid=5744): Terminated: ok {rc=0} 07:09:13.268659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5746): Launched 07:09:13.600313 run osmo-hlr_10.42.42.2(pid=5747): Launched 07:09:13.724549 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:14.292689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5749): Launched 07:09:14.623684 run osmo-stp_10.42.42.5(pid=5750): Launched 07:09:14.749867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:15.323850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5752): Launched 07:09:15.449767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:15.733666 run patchelf(pid=5753): Launched 07:09:15.936094 run osmo-stp_10.42.42.5(pid=5750): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5750)] 07:09:16.076902 run osmo-stp_10.42.42.5(pid=5750): stdout: | (launched: 2022-12-09_07:09:14.561800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:16.215884 run osmo-stp_10.42.42.5(pid=5750): stderr: | 20221209070914753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070914753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070914753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070914754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070914754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070914754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070914754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:16.353804 run osmo-stp_10.42.42.5(pid=5750): stdout: | (launched: 2022-12-09_07:09:14.561800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:16.484319 run osmo-stp_10.42.42.5(pid=5750): stderr: | 20221209070914753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070914753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070914753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070914754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070914754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070914754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070914754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:16.640922 run patchelf(pid=5753): Terminating (SIGINT) 07:09:16.821840 run patchelf(pid=5753): Terminated: ok {rc=0} 07:09:16.951630 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5750): Process ended prematurely: osmo-stp_10.42.42.5(pid=5750) [trial-2356↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5750)] [trial-2356↪gprs:oc2g↪cs_paging_gprs_active.py:38] 07:09:16.962244 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 07:09:16.994904 run osmo-hlr_10.42.42.2(pid=5747): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5747)] 07:09:17.046713 run osmo-hlr_10.42.42.2(pid=5747): stdout: | (launched: 2022-12-09_07:09:13.538151) 07:09:17.099276 run osmo-hlr_10.42.42.2(pid=5747): stderr: | 20221209070913735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070913735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070913735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070913735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070913735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070913735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070913748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070913757 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070913757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070913758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:17.153954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5740): Terminating (SIGTERM) 07:09:17.195441 run iperf3-srv_10.42.42.10(pid=5741): Terminating (SIGTERM) 07:09:17.236201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5742): Terminating (SIGTERM) 07:09:17.276807 run iperf3-srv_10.42.42.10(pid=5743): Terminating (SIGTERM) 07:09:17.317637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5746): Terminating (SIGTERM) 07:09:17.358323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5749): Terminating (SIGTERM) 07:09:17.398758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5752): Terminating (SIGTERM) 07:09:17.439554 --- ParallelTerminationStrategy: PID 5740 died... 07:09:17.458490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5740): Terminated: ok {rc=0} 07:09:17.503643 --- ParallelTerminationStrategy: PID 5741 died... 07:09:17.522466 run iperf3-srv_10.42.42.10(pid=5741): Terminated {rc=256} 07:09:17.567256 --- ParallelTerminationStrategy: PID 5742 died... 07:09:17.585900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5742): Terminated: ok {rc=0} 07:09:17.630114 --- ParallelTerminationStrategy: PID 5743 died... 07:09:17.648641 run iperf3-srv_10.42.42.10(pid=5743): Terminated {rc=256} 07:09:17.692843 --- ParallelTerminationStrategy: PID 5746 died... 07:09:17.711514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5746): Terminated: ok {rc=0} 07:09:17.755606 --- ParallelTerminationStrategy: PID 5749 died... 07:09:17.774163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5749): Terminated: ok {rc=0} 07:09:17.818802 --- ParallelTerminationStrategy: PID 5752 died... 07:09:17.837601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5752): Terminated: ok {rc=0} 07:09:17.923968 bus /gobi_0: Setting Powered False 07:09:19.021843 bus /gobi_0: Setting Powered False 07:09:20.138838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g iperf3.py ---------------------------------------------- 07:09:21.289453 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.301247 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:09:21.337553 tst iperf3.py: using LAC 19783 07:09:21.466859 tst iperf3.py: using RAC 148 07:09:21.597065 tst iperf3.py: using CellId 19783 07:09:21.726307 tst iperf3.py: using BVCI 19784 07:09:21.848048 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.859145 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.870269 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.881265 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.892328 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.903156 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.914138 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.925054 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:21.936547 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:22.060581 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:09:22.286338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:22.622129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5754): Launched 07:09:22.917857 run iperf3-srv_10.42.42.10(pid=5755): Launched 07:09:23.043658 tst iperf3.py:8: start network... 07:09:23.267978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:23.784846 run create_hlr_db(pid=5756): Launched 07:09:23.919623 bus /gobi_6: Setting Powered False 07:09:24.984497 run create_hlr_db(pid=5756): Terminated: ok {rc=0} 07:09:25.429354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5758): Launched 07:09:25.741267 run osmo-hlr_10.42.42.2(pid=5759): Launched 07:09:25.859970 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:26.408162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5761): Launched 07:09:26.721234 run osmo-stp_10.42.42.5(pid=5762): Launched 07:09:26.840679 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:27.376186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5764): Launched 07:09:27.496456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:27.760691 run patchelf(pid=5765): Launched 07:09:27.933414 run osmo-stp_10.42.42.5(pid=5762): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5762)] 07:09:28.064024 run osmo-stp_10.42.42.5(pid=5762): stdout: | (launched: 2022-12-09_07:09:26.662465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:28.196257 run osmo-stp_10.42.42.5(pid=5762): stderr: | 20221209070926832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070926833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070926833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070926833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070926834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070926834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070926834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:28.328746 run osmo-stp_10.42.42.5(pid=5762): stdout: | (launched: 2022-12-09_07:09:26.662465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:28.455390 run osmo-stp_10.42.42.5(pid=5762): stderr: | 20221209070926832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070926833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070926833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070926833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070926834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070926834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070926834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:28.604742 run patchelf(pid=5765): Terminating (SIGINT) 07:09:28.777662 run patchelf(pid=5765): Terminated: ok {rc=0} 07:09:28.902263 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5762): Process ended prematurely: osmo-stp_10.42.42.5(pid=5762) [trial-2356↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5762)] [trial-2356↪gprs:oc2g↪iperf3.py:8] 07:09:28.911947 tst iperf3.py:8: Test FAILED (7.7 sec) 07:09:28.940029 run osmo-hlr_10.42.42.2(pid=5759): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5759)] 07:09:28.987907 run osmo-hlr_10.42.42.2(pid=5759): stdout: | (launched: 2022-12-09_07:09:25.682606) 07:09:29.037625 run osmo-hlr_10.42.42.2(pid=5759): stderr: | 20221209070925859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070925859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070925859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070925859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070925859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070925859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070925876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070925885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070925885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070925885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:29.087782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5754): Terminating (SIGTERM) 07:09:29.127534 run iperf3-srv_10.42.42.10(pid=5755): Terminating (SIGTERM) 07:09:29.167312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5758): Terminating (SIGTERM) 07:09:29.207294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5761): Terminating (SIGTERM) 07:09:29.247135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5764): Terminating (SIGTERM) 07:09:29.287209 --- ParallelTerminationStrategy: PID 5754 died... 07:09:29.306271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5754): Terminated: ok {rc=0} 07:09:29.350710 --- ParallelTerminationStrategy: PID 5755 died... 07:09:29.369248 run iperf3-srv_10.42.42.10(pid=5755): Terminated {rc=256} 07:09:29.413319 --- ParallelTerminationStrategy: PID 5758 died... 07:09:29.431812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5758): Terminated: ok {rc=0} 07:09:29.476757 --- ParallelTerminationStrategy: PID 5761 died... 07:09:29.495480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5761): Terminated: ok {rc=0} 07:09:29.539959 --- ParallelTerminationStrategy: PID 5764 died... 07:09:29.558716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5764): Terminated: ok {rc=0} 07:09:29.644920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g iperf3m4.py ---------------------------------------------- 07:09:30.795437 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:30.807261 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:09:30.859380 tst iperf3m4.py: using LAC 19784 07:09:30.998145 tst iperf3m4.py: using RAC 149 07:09:31.128680 tst iperf3m4.py: using CellId 19784 07:09:31.286646 tst iperf3m4.py: using BVCI 19785 07:09:31.411674 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.423676 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.435692 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.447942 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.461039 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.473381 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.485403 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.497611 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:31.510490 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:31.637494 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:31.767780 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:31.894378 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:32.041173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:09:32.298261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:32.635704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5766): Launched 07:09:32.926936 run iperf3-srv_10.42.42.10(pid=5767): Launched 07:09:33.052105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:09:33.277400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:33.613420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5768): Launched 07:09:33.902965 run iperf3-srv_10.42.42.10(pid=5769): Launched 07:09:34.029469 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:09:34.254336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:34.590549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5770): Launched 07:09:34.882988 run iperf3-srv_10.42.42.10(pid=5771): Launched 07:09:35.009257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:09:35.234098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:35.569716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5772): Launched 07:09:35.861288 run iperf3-srv_10.42.42.10(pid=5773): Launched 07:09:35.987431 tst iperf3m4.py:8: start network... 07:09:36.213282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:36.732787 run create_hlr_db(pid=5774): Launched 07:09:36.868349 bus /gobi_6: Setting Powered False 07:09:37.934516 run create_hlr_db(pid=5774): Terminated: ok {rc=0} 07:09:38.378467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5776): Launched 07:09:38.693122 run osmo-hlr_10.42.42.2(pid=5777): Launched 07:09:38.813212 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:39.359188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5779): Launched 07:09:39.672694 run osmo-stp_10.42.42.5(pid=5780): Launched 07:09:39.792622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:40.336714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5782): Launched 07:09:40.459397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:40.727778 run patchelf(pid=5783): Launched 07:09:40.903721 run osmo-stp_10.42.42.5(pid=5780): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5780)] 07:09:41.040843 run osmo-stp_10.42.42.5(pid=5780): stdout: | (launched: 2022-12-09_07:09:39.613449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:41.178822 run osmo-stp_10.42.42.5(pid=5780): stderr: | 20221209070939784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070939784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070939784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070939785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070939785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070939785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070939785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:41.312061 run osmo-stp_10.42.42.5(pid=5780): stdout: | (launched: 2022-12-09_07:09:39.613449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:41.439423 run osmo-stp_10.42.42.5(pid=5780): stderr: | 20221209070939784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070939784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070939784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070939785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070939785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070939785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070939785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:41.591222 run patchelf(pid=5783): Terminating (SIGINT) 07:09:41.766077 run patchelf(pid=5783): Terminated: ok {rc=0} 07:09:41.891779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5780): Process ended prematurely: osmo-stp_10.42.42.5(pid=5780) [trial-2356↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5780)] [trial-2356↪gprs:oc2g↪iperf3m4.py:8] 07:09:41.901620 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:09:41.930257 run osmo-hlr_10.42.42.2(pid=5777): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5777)] 07:09:41.979277 run osmo-hlr_10.42.42.2(pid=5777): stdout: | (launched: 2022-12-09_07:09:38.634196) 07:09:42.029922 run osmo-hlr_10.42.42.2(pid=5777): stderr: | 20221209070938812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070938812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070938812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070938812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070938812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070938812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070938824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070938832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070938832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070938833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:42.080879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5766): Terminating (SIGTERM) 07:09:42.122203 run iperf3-srv_10.42.42.10(pid=5767): Terminating (SIGTERM) 07:09:42.162487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5768): Terminating (SIGTERM) 07:09:42.203482 run iperf3-srv_10.42.42.10(pid=5769): Terminating (SIGTERM) 07:09:42.244189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5770): Terminating (SIGTERM) 07:09:42.284916 run iperf3-srv_10.42.42.10(pid=5771): Terminating (SIGTERM) 07:09:42.325433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5772): Terminating (SIGTERM) 07:09:42.366069 run iperf3-srv_10.42.42.10(pid=5773): Terminating (SIGTERM) 07:09:42.406572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5776): Terminating (SIGTERM) 07:09:42.447187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5779): Terminating (SIGTERM) 07:09:42.487770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5782): Terminating (SIGTERM) 07:09:42.528726 --- ParallelTerminationStrategy: PID 5766 died... 07:09:42.548288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5766): Terminated: ok {rc=0} 07:09:42.593651 --- ParallelTerminationStrategy: PID 5767 died... 07:09:42.612377 run iperf3-srv_10.42.42.10(pid=5767): Terminated {rc=256} 07:09:42.657723 --- ParallelTerminationStrategy: PID 5768 died... 07:09:42.676669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5768): Terminated: ok {rc=0} 07:09:42.721951 --- ParallelTerminationStrategy: PID 5769 died... 07:09:42.740767 run iperf3-srv_10.42.42.10(pid=5769): Terminated {rc=256} 07:09:42.786269 --- ParallelTerminationStrategy: PID 5770 died... 07:09:42.805262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5770): Terminated: ok {rc=0} 07:09:42.850914 --- ParallelTerminationStrategy: PID 5771 died... 07:09:42.869863 run iperf3-srv_10.42.42.10(pid=5771): Terminated {rc=256} 07:09:42.916077 --- ParallelTerminationStrategy: PID 5772 died... 07:09:42.935092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5772): Terminated: ok {rc=0} 07:09:42.980263 --- ParallelTerminationStrategy: PID 5773 died... 07:09:42.999173 run iperf3-srv_10.42.42.10(pid=5773): Terminated {rc=256} 07:09:43.044273 --- ParallelTerminationStrategy: PID 5776 died... 07:09:43.063368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5776): Terminated: ok {rc=0} 07:09:43.108504 --- ParallelTerminationStrategy: PID 5779 died... 07:09:43.127675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5779): Terminated: ok {rc=0} 07:09:43.172913 --- ParallelTerminationStrategy: PID 5782 died... 07:09:43.192433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5782): Terminated: ok {rc=0} 07:09:43.280025 bus /gobi_4: Setting Powered False 07:09:44.381397 bus /gobi_4: Setting Powered False 07:09:45.498430 bus /gobi_1: Setting Powered False 07:09:46.597441 bus /gobi_1: Setting Powered False 07:09:47.715880 bus /gobi_0: Setting Powered False 07:09:48.816353 bus /gobi_0: Setting Powered False 07:09:49.934472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g ping.py ---------------------------------------------- 07:09:51.039262 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.051364 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:09:51.088532 tst ping.py: using LAC 19785 07:09:51.217383 tst ping.py: using RAC 150 07:09:51.368363 tst ping.py: using CellId 19785 07:09:51.488393 tst ping.py: using BVCI 19786 07:09:51.597817 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.608393 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.618936 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.629722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.640312 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.650918 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.661727 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:51.672870 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:51.787463 tst ping.py:19: start network... 07:09:51.989206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:52.455747 run create_hlr_db(pid=5785): Launched 07:09:52.571282 bus /gobi_6: Setting Powered False 07:09:53.632028 run create_hlr_db(pid=5785): Terminated: ok {rc=0} 07:09:54.056259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5787): Launched 07:09:54.361488 run osmo-hlr_10.42.42.2(pid=5788): Launched 07:09:54.477391 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:55.006622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5790): Launched 07:09:55.311192 run osmo-stp_10.42.42.5(pid=5791): Launched 07:09:55.428376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:55.953855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5793): Launched 07:09:56.071720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:56.328264 run patchelf(pid=5794): Launched 07:09:56.498206 run osmo-stp_10.42.42.5(pid=5791): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5791)] 07:09:56.628165 run osmo-stp_10.42.42.5(pid=5791): stdout: | (launched: 2022-12-09_07:09:55.254718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:56.758728 run osmo-stp_10.42.42.5(pid=5791): stderr: | 20221209070955422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070955422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070955422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070955423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070955423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070955423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070955423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:56.889165 run osmo-stp_10.42.42.5(pid=5791): stdout: | (launched: 2022-12-09_07:09:55.254718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:57.014457 run osmo-stp_10.42.42.5(pid=5791): stderr: | 20221209070955422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209070955422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209070955422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209070955423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209070955423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209070955423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209070955423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:57.162763 run patchelf(pid=5794): Terminating (SIGINT) 07:09:57.332692 run patchelf(pid=5794): Terminated: ok {rc=0} 07:09:57.455141 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5791): Process ended prematurely: osmo-stp_10.42.42.5(pid=5791) [trial-2356↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5791)] [trial-2356↪gprs:oc2g↪ping.py:22] 07:09:57.464299 tst ping.py:22: Test FAILED (6.4 sec) 07:09:57.492434 run osmo-hlr_10.42.42.2(pid=5788): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5788)] 07:09:57.541695 run osmo-hlr_10.42.42.2(pid=5788): stdout: | (launched: 2022-12-09_07:09:54.304502) 07:09:57.592594 run osmo-hlr_10.42.42.2(pid=5788): stderr: | 20221209070954478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209070954478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209070954478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209070954479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209070954479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209070954479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209070954490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209070954501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209070954502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209070954502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:57.643716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5787): Terminating (SIGTERM) 07:09:57.684545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5790): Terminating (SIGTERM) 07:09:57.725710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5793): Terminating (SIGTERM) 07:09:57.767143 --- ParallelTerminationStrategy: PID 5787 died... 07:09:57.786462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5787): Terminated: ok {rc=0} 07:09:57.832605 --- ParallelTerminationStrategy: PID 5790 died... 07:09:57.852049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5790): Terminated: ok {rc=0} 07:09:57.897771 --- ParallelTerminationStrategy: PID 5793 died... 07:09:57.917106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5793): Terminated: ok {rc=0} 07:09:58.004818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 07:09:59.094729 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.106135 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:09:59.143589 tst ping_idle_ping.py: using LAC 19786 07:09:59.263962 tst ping_idle_ping.py: using RAC 151 07:09:59.385041 tst ping_idle_ping.py: using CellId 19786 07:09:59.503887 tst ping_idle_ping.py: using BVCI 19787 07:09:59.616167 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.626847 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.637464 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.648269 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.659098 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.669849 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.680554 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:59.691460 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:59.811039 tst ping_idle_ping.py:24: start network... 07:10:00.033631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:00.546062 run create_hlr_db(pid=5795): Launched 07:10:00.681366 bus /gobi_6: Setting Powered False 07:10:01.770334 run create_hlr_db(pid=5795): Terminated: ok {rc=0} 07:10:02.273607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5800): Launched 07:10:02.605162 run osmo-hlr_10.42.42.2(pid=5801): Launched 07:10:02.722449 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:03.259491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5803): Launched 07:10:03.564934 run osmo-stp_10.42.42.5(pid=5804): Launched 07:10:03.681396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:04.207902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5806): Launched 07:10:04.325153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:04.583220 run patchelf(pid=5807): Launched 07:10:04.754746 run osmo-stp_10.42.42.5(pid=5804): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5804)] 07:10:04.884149 run osmo-stp_10.42.42.5(pid=5804): stdout: | (launched: 2022-12-09_07:10:03.508389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:05.014802 run osmo-stp_10.42.42.5(pid=5804): stderr: | 20221209071003677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071003677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071003678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071003678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071003679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071003679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071003679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:05.145817 run osmo-stp_10.42.42.5(pid=5804): stdout: | (launched: 2022-12-09_07:10:03.508389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:05.270964 run osmo-stp_10.42.42.5(pid=5804): stderr: | 20221209071003677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071003677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071003678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071003678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071003679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071003679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071003679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:05.419338 run patchelf(pid=5807): Terminating (SIGINT) 07:10:05.589812 run patchelf(pid=5807): Terminated: ok {rc=0} 07:10:05.713069 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5804): Process ended prematurely: osmo-stp_10.42.42.5(pid=5804) [trial-2356↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5804)] [trial-2356↪gprs:oc2g↪ping_idle_ping.py:27] 07:10:05.722065 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:10:05.749856 run osmo-hlr_10.42.42.2(pid=5801): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5801)] 07:10:05.798868 run osmo-hlr_10.42.42.2(pid=5801): stdout: | (launched: 2022-12-09_07:10:02.548187) 07:10:05.849264 run osmo-hlr_10.42.42.2(pid=5801): stderr: | 20221209071002720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071002720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071002720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071002720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071002720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071002720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071002734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071002742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071002742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071002742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:05.900338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5800): Terminating (SIGTERM) 07:10:05.940811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5803): Terminating (SIGTERM) 07:10:05.981258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5806): Terminating (SIGTERM) 07:10:06.021945 --- ParallelTerminationStrategy: PID 5800 died... 07:10:06.041371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5800): Terminated: ok {rc=0} 07:10:06.086581 --- ParallelTerminationStrategy: PID 5803 died... 07:10:06.105688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5803): Terminated: ok {rc=0} 07:10:06.151311 --- ParallelTerminationStrategy: PID 5806 died... 07:10:06.170338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5806): Terminated: ok {rc=0} 07:10:06.255581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 07:10:07.555573 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:10:07.561881 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:10:07.586247 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:10:07.625882 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:10:07.714186 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:10:07.735775 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:10:07.775809 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:10:08.366849 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:10:08.416303 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:08.427355 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:10:08.463397 tst cs_paging_gprs_active.py: using LAC 19787 07:10:08.585749 tst cs_paging_gprs_active.py: using RAC 152 07:10:08.705547 tst cs_paging_gprs_active.py: using CellId 19787 07:10:08.824684 tst cs_paging_gprs_active.py: using BVCI 19788 07:10:08.935626 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:08.946679 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:08.957604 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:08.968756 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:08.979958 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:08.991004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:09.002339 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:09.013280 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:09.024556 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:09.142276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:09.262135 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:10:09.483010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:09.810462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5812): Launched 07:10:10.094780 run iperf3-srv_10.42.42.10(pid=5813): Launched 07:10:10.217138 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:10:10.436873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:10.763489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5814): Launched 07:10:11.046017 run iperf3-srv_10.42.42.10(pid=5815): Launched 07:10:11.169485 tst cs_paging_gprs_active.py:38: start network... 07:10:11.388580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:11.896425 run create_hlr_db(pid=5816): Launched 07:10:12.029957 bus /gobi_6: Setting Powered False 07:10:13.094848 run create_hlr_db(pid=5816): Terminated: ok {rc=0} 07:10:13.531261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5818): Launched 07:10:13.836501 run osmo-hlr_10.42.42.2(pid=5819): Launched 07:10:13.953492 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:14.487526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5821): Launched 07:10:14.792720 run osmo-stp_10.42.42.5(pid=5822): Launched 07:10:14.909981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:15.436549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5824): Launched 07:10:15.554370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:15.813017 run patchelf(pid=5825): Launched 07:10:16.015744 run osmo-stp_10.42.42.5(pid=5822): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5822)] 07:10:16.191671 run osmo-stp_10.42.42.5(pid=5822): stdout: | (launched: 2022-12-09_07:10:14.736722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:16.369937 run osmo-stp_10.42.42.5(pid=5822): stderr: | 20221209071014905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071014905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071014906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071014906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071014906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071014906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071014907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:16.545345 run osmo-stp_10.42.42.5(pid=5822): stdout: | (launched: 2022-12-09_07:10:14.736722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:16.714233 run osmo-stp_10.42.42.5(pid=5822): stderr: | 20221209071014905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071014905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071014906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071014906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071014906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071014906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071014907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:16.894806 run patchelf(pid=5825): Terminating (SIGINT) 07:10:17.082541 run patchelf(pid=5825): Terminated: ok {rc=0} 07:10:17.217138 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5822): Process ended prematurely: osmo-stp_10.42.42.5(pid=5822) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5822)] [trial-2356↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:10:17.228136 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:10:17.257865 run osmo-hlr_10.42.42.2(pid=5819): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5819)] 07:10:17.308477 run osmo-hlr_10.42.42.2(pid=5819): stdout: | (launched: 2022-12-09_07:10:13.780489) 07:10:17.360320 run osmo-hlr_10.42.42.2(pid=5819): stderr: | 20221209071013955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071013955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071013955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071013955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071013955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071013955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071013968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071013978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071013978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071013978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:17.412562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5812): Terminating (SIGTERM) 07:10:17.454484 run iperf3-srv_10.42.42.10(pid=5813): Terminating (SIGTERM) 07:10:17.496510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5814): Terminating (SIGTERM) 07:10:17.538889 run iperf3-srv_10.42.42.10(pid=5815): Terminating (SIGTERM) 07:10:17.580683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5818): Terminating (SIGTERM) 07:10:17.622798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5821): Terminating (SIGTERM) 07:10:17.665973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5824): Terminating (SIGTERM) 07:10:17.707959 --- ParallelTerminationStrategy: PID 5812 died... 07:10:17.727948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5812): Terminated: ok {rc=0} 07:10:17.774806 --- ParallelTerminationStrategy: PID 5813 died... 07:10:17.794547 run iperf3-srv_10.42.42.10(pid=5813): Terminated {rc=256} 07:10:17.840698 --- ParallelTerminationStrategy: PID 5814 died... 07:10:17.860248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5814): Terminated: ok {rc=0} 07:10:17.906488 --- ParallelTerminationStrategy: PID 5815 died... 07:10:17.926139 run iperf3-srv_10.42.42.10(pid=5815): Terminated {rc=256} 07:10:17.972544 --- ParallelTerminationStrategy: PID 5818 died... 07:10:17.992249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5818): Terminated: ok {rc=0} 07:10:18.038820 --- ParallelTerminationStrategy: PID 5821 died... 07:10:18.058379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5821): Terminated: ok {rc=0} 07:10:18.104729 --- ParallelTerminationStrategy: PID 5824 died... 07:10:18.124481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5824): Terminated: ok {rc=0} 07:10:18.212710 bus /gobi_0: Setting Powered False 07:10:19.312936 bus /gobi_0: Setting Powered False 07:10:20.429820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:10:21.579409 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:21.591651 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:10:21.630663 tst iperf3.py: using LAC 19788 07:10:21.759264 tst iperf3.py: using RAC 153 07:10:21.894388 tst iperf3.py: using CellId 19788 07:10:22.022662 tst iperf3.py: using BVCI 19789 07:10:22.141728 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.153036 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.164264 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.175483 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.186601 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.197839 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.209150 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.220262 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:22.231579 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:22.353416 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:10:22.573214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:22.901061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5826): Launched 07:10:23.183556 run iperf3-srv_10.42.42.10(pid=5827): Launched 07:10:23.304740 tst iperf3.py:8: start network... 07:10:23.524007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:24.027691 run create_hlr_db(pid=5828): Launched 07:10:24.159808 bus /gobi_6: Setting Powered False 07:10:25.224644 run create_hlr_db(pid=5828): Terminated: ok {rc=0} 07:10:25.658890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5830): Launched 07:10:25.964050 run osmo-hlr_10.42.42.2(pid=5831): Launched 07:10:26.079910 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:26.613252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5833): Launched 07:10:26.918880 run osmo-stp_10.42.42.5(pid=5834): Launched 07:10:27.035645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:27.561498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5836): Launched 07:10:27.677723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:27.935296 run patchelf(pid=5837): Launched 07:10:28.104719 run osmo-stp_10.42.42.5(pid=5834): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5834)] 07:10:28.233971 run osmo-stp_10.42.42.5(pid=5834): stdout: | (launched: 2022-12-09_07:10:26.862367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:28.364782 run osmo-stp_10.42.42.5(pid=5834): stderr: | 20221209071027030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071027030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071027030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071027031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071027031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071027031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071027031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:28.495947 run osmo-stp_10.42.42.5(pid=5834): stdout: | (launched: 2022-12-09_07:10:26.862367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:28.621198 run osmo-stp_10.42.42.5(pid=5834): stderr: | 20221209071027030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071027030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071027030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071027031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071027031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071027031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071027031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:28.769507 run patchelf(pid=5837): Terminating (SIGINT) 07:10:28.940203 run patchelf(pid=5837): Terminated: ok {rc=0} 07:10:29.063205 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5834): Process ended prematurely: osmo-stp_10.42.42.5(pid=5834) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5834)] [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 07:10:29.072754 tst iperf3.py:8: Test FAILED (7.5 sec) 07:10:29.100362 run osmo-hlr_10.42.42.2(pid=5831): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5831)] 07:10:29.149149 run osmo-hlr_10.42.42.2(pid=5831): stdout: | (launched: 2022-12-09_07:10:25.907599) 07:10:29.199317 run osmo-hlr_10.42.42.2(pid=5831): stderr: | 20221209071026083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071026083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071026083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071026083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071026083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071026083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071026095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071026104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071026104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071026104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:29.250109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5826): Terminating (SIGTERM) 07:10:29.290522 run iperf3-srv_10.42.42.10(pid=5827): Terminating (SIGTERM) 07:10:29.330791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5830): Terminating (SIGTERM) 07:10:29.371406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5833): Terminating (SIGTERM) 07:10:29.411659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5836): Terminating (SIGTERM) 07:10:29.452109 --- ParallelTerminationStrategy: PID 5826 died... 07:10:29.471228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5826): Terminated: ok {rc=0} 07:10:29.516097 --- ParallelTerminationStrategy: PID 5827 died... 07:10:29.534822 run iperf3-srv_10.42.42.10(pid=5827): Terminated {rc=256} 07:10:29.579614 --- ParallelTerminationStrategy: PID 5830 died... 07:10:29.598566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5830): Terminated: ok {rc=0} 07:10:29.643493 --- ParallelTerminationStrategy: PID 5833 died... 07:10:29.662268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5833): Terminated: ok {rc=0} 07:10:29.707599 --- ParallelTerminationStrategy: PID 5836 died... 07:10:29.726393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5836): Terminated: ok {rc=0} 07:10:29.812534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:10:30.973547 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:30.985843 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:10:31.028189 tst iperf3m4.py: using LAC 19789 07:10:31.148494 tst iperf3m4.py: using RAC 154 07:10:31.267609 tst iperf3m4.py: using CellId 19789 07:10:31.391064 tst iperf3m4.py: using BVCI 19790 07:10:31.515715 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.527431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.538860 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.550776 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.562444 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.574059 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.585870 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.597798 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:31.609845 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:31.752438 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:31.877565 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:31.999739 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:32.120557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:10:32.351447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:32.661236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5838): Launched 07:10:32.927890 run iperf3-srv_10.42.42.10(pid=5839): Launched 07:10:33.042746 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:10:33.247128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:33.554471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5840): Launched 07:10:33.820334 run iperf3-srv_10.42.42.10(pid=5841): Launched 07:10:33.934727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:10:34.139677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:34.446932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5842): Launched 07:10:34.714162 run iperf3-srv_10.42.42.10(pid=5843): Launched 07:10:34.831080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:10:35.034998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:35.342675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5844): Launched 07:10:35.608203 run iperf3-srv_10.42.42.10(pid=5845): Launched 07:10:35.722680 tst iperf3m4.py:8: start network... 07:10:35.927962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:36.402026 run create_hlr_db(pid=5846): Launched 07:10:36.540010 bus /gobi_6: Setting Powered False 07:10:37.603602 run create_hlr_db(pid=5846): Terminated: ok {rc=0} 07:10:38.058320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Launched 07:10:38.385662 run osmo-hlr_10.42.42.2(pid=5849): Launched 07:10:38.508777 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:39.070924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Launched 07:10:39.399268 run osmo-stp_10.42.42.5(pid=5852): Launched 07:10:39.523756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:40.091028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5854): Launched 07:10:40.217905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:40.495723 run patchelf(pid=5855): Launched 07:10:40.678747 run osmo-stp_10.42.42.5(pid=5852): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] 07:10:40.817219 run osmo-stp_10.42.42.5(pid=5852): stdout: | (launched: 2022-12-09_07:10:39.338845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:40.957250 run osmo-stp_10.42.42.5(pid=5852): stderr: | 20221209071039527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071039527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071039528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071039528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071039529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071039529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071039529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:41.097834 run osmo-stp_10.42.42.5(pid=5852): stdout: | (launched: 2022-12-09_07:10:39.338845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:41.232126 run osmo-stp_10.42.42.5(pid=5852): stderr: | 20221209071039527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071039527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071039528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071039528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071039529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071039529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071039529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:41.391529 run patchelf(pid=5855): Terminating (SIGINT) 07:10:41.574544 run patchelf(pid=5855): Terminated: ok {rc=0} 07:10:41.705993 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5852): Process ended prematurely: osmo-stp_10.42.42.5(pid=5852) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 07:10:41.716352 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:10:41.745343 run osmo-hlr_10.42.42.2(pid=5849): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5849)] 07:10:41.795915 run osmo-hlr_10.42.42.2(pid=5849): stdout: | (launched: 2022-12-09_07:10:38.325941) 07:10:41.848279 run osmo-hlr_10.42.42.2(pid=5849): stderr: | 20221209071038519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071038519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071038519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071038519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071038519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071038519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071038532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071038541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071038541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071038542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:41.901483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5838): Terminating (SIGTERM) 07:10:41.944747 run iperf3-srv_10.42.42.10(pid=5839): Terminating (SIGTERM) 07:10:41.987832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5840): Terminating (SIGTERM) 07:10:42.030466 run iperf3-srv_10.42.42.10(pid=5841): Terminating (SIGTERM) 07:10:42.072881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5842): Terminating (SIGTERM) 07:10:42.115346 run iperf3-srv_10.42.42.10(pid=5843): Terminating (SIGTERM) 07:10:42.158185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5844): Terminating (SIGTERM) 07:10:42.201348 run iperf3-srv_10.42.42.10(pid=5845): Terminating (SIGTERM) 07:10:42.243873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Terminating (SIGTERM) 07:10:42.286268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Terminating (SIGTERM) 07:10:42.328291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5854): Terminating (SIGTERM) 07:10:42.371195 --- ParallelTerminationStrategy: PID 5838 died... 07:10:42.391519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5838): Terminated: ok {rc=0} 07:10:42.438771 --- ParallelTerminationStrategy: PID 5839 died... 07:10:42.458713 run iperf3-srv_10.42.42.10(pid=5839): Terminated {rc=256} 07:10:42.505344 --- ParallelTerminationStrategy: PID 5840 died... 07:10:42.525084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5840): Terminated: ok {rc=0} 07:10:42.571785 --- ParallelTerminationStrategy: PID 5841 died... 07:10:42.591638 run iperf3-srv_10.42.42.10(pid=5841): Terminated {rc=256} 07:10:42.637662 --- ParallelTerminationStrategy: PID 5842 died... 07:10:42.657518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5842): Terminated: ok {rc=0} 07:10:42.704175 --- ParallelTerminationStrategy: PID 5843 died... 07:10:42.723998 run iperf3-srv_10.42.42.10(pid=5843): Terminated {rc=256} 07:10:42.770729 --- ParallelTerminationStrategy: PID 5844 died... 07:10:42.790583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5844): Terminated: ok {rc=0} 07:10:42.837376 --- ParallelTerminationStrategy: PID 5845 died... 07:10:42.857292 run iperf3-srv_10.42.42.10(pid=5845): Terminated {rc=256} 07:10:42.903888 --- ParallelTerminationStrategy: PID 5848 died... 07:10:42.923655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Terminated: ok {rc=0} 07:10:42.970135 --- ParallelTerminationStrategy: PID 5851 died... 07:10:42.989944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Terminated: ok {rc=0} 07:10:43.036794 --- ParallelTerminationStrategy: PID 5854 died... 07:10:43.056734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5854): Terminated: ok {rc=0} 07:10:43.145949 bus /gobi_4: Setting Powered False 07:10:44.246929 bus /gobi_4: Setting Powered False 07:10:45.363286 bus /gobi_1: Setting Powered False 07:10:46.459886 bus /gobi_1: Setting Powered False 07:10:47.573818 bus /gobi_0: Setting Powered False 07:10:48.673153 bus /gobi_0: Setting Powered False 07:10:49.793469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 07:10:50.898786 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:50.911018 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:10:50.949847 tst ping.py: using LAC 19790 07:10:51.078869 tst ping.py: using RAC 155 07:10:51.206629 tst ping.py: using CellId 19790 07:10:51.339305 tst ping.py: using BVCI 19791 07:10:51.457717 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.469256 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.480678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.491998 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.503173 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.514382 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.525778 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:51.537038 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:51.652890 tst ping.py:19: start network... 07:10:51.853656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:52.320570 run create_hlr_db(pid=5856): Launched 07:10:52.435844 bus /gobi_6: Setting Powered False 07:10:53.495322 run create_hlr_db(pid=5856): Terminated: ok {rc=0} 07:10:53.915997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5858): Launched 07:10:54.218919 run osmo-hlr_10.42.42.2(pid=5859): Launched 07:10:54.334651 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:54.867782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5861): Launched 07:10:55.169404 run osmo-stp_10.42.42.5(pid=5862): Launched 07:10:55.284824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:55.803927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5864): Launched 07:10:55.919500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:56.174535 run patchelf(pid=5865): Launched 07:10:56.342699 run osmo-stp_10.42.42.5(pid=5862): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5862)] 07:10:56.470371 run osmo-stp_10.42.42.5(pid=5862): stdout: | (launched: 2022-12-09_07:10:55.113238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:56.599500 run osmo-stp_10.42.42.5(pid=5862): stderr: | 20221209071055279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071055279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071055279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071055280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071055280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071055280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071055280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:56.728678 run osmo-stp_10.42.42.5(pid=5862): stdout: | (launched: 2022-12-09_07:10:55.113238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:56.852096 run osmo-stp_10.42.42.5(pid=5862): stderr: | 20221209071055279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071055279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071055279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071055280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071055280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071055280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071055280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:56.998822 run patchelf(pid=5865): Terminating (SIGINT) 07:10:57.167707 run patchelf(pid=5865): Terminated: ok {rc=0} 07:10:57.289322 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5862): Process ended prematurely: osmo-stp_10.42.42.5(pid=5862) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5862)] [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 07:10:57.298305 tst ping.py:22: Test FAILED (6.4 sec) 07:10:57.325572 run osmo-hlr_10.42.42.2(pid=5859): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5859)] 07:10:57.373735 run osmo-hlr_10.42.42.2(pid=5859): stdout: | (launched: 2022-12-09_07:10:54.162481) 07:10:57.423475 run osmo-hlr_10.42.42.2(pid=5859): stderr: | 20221209071054336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071054336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071054336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071054336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071054336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071054336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071054348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071054356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071054357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071054357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:57.473804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5858): Terminating (SIGTERM) 07:10:57.514081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5861): Terminating (SIGTERM) 07:10:57.554450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5864): Terminating (SIGTERM) 07:10:57.594866 --- ParallelTerminationStrategy: PID 5858 died... 07:10:57.614112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5858): Terminated: ok {rc=0} 07:10:57.658930 --- ParallelTerminationStrategy: PID 5861 died... 07:10:57.677713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5861): Terminated: ok {rc=0} 07:10:57.722297 --- ParallelTerminationStrategy: PID 5864 died... 07:10:57.740807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5864): Terminated: ok {rc=0} 07:10:57.827699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:10:58.915317 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:58.926997 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:10:58.965642 tst ping_idle_ping.py: using LAC 19791 07:10:59.094408 tst ping_idle_ping.py: using RAC 156 07:10:59.223682 tst ping_idle_ping.py: using CellId 19791 07:10:59.350888 tst ping_idle_ping.py: using BVCI 19792 07:10:59.470605 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.482237 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.493689 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.505589 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.517348 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.529408 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.541651 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:10:59.553671 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:10:59.671456 tst ping_idle_ping.py:24: start network... 07:10:59.874321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:00.346474 run create_hlr_db(pid=5866): Launched 07:11:00.464216 bus /gobi_6: Setting Powered False 07:11:01.538971 run create_hlr_db(pid=5866): Terminated: ok {rc=0} 07:11:02.007975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5868): Launched 07:11:02.339379 run osmo-hlr_10.42.42.2(pid=5869): Launched 07:11:02.465402 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:03.026711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5871): Launched 07:11:03.351992 run osmo-stp_10.42.42.5(pid=5872): Launched 07:11:03.476152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:04.036160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5874): Launched 07:11:04.159699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:04.434684 run patchelf(pid=5875): Launched 07:11:04.615965 run osmo-stp_10.42.42.5(pid=5872): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5872)] 07:11:04.753047 run osmo-stp_10.42.42.5(pid=5872): stdout: | (launched: 2022-12-09_07:11:03.292030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:04.891418 run osmo-stp_10.42.42.5(pid=5872): stderr: | 20221209071103481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071103481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071103481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071103482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071103482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071103482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071103482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:05.030182 run osmo-stp_10.42.42.5(pid=5872): stdout: | (launched: 2022-12-09_07:11:03.292030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:05.163708 run osmo-stp_10.42.42.5(pid=5872): stderr: | 20221209071103481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071103481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071103481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071103482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071103482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071103482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071103482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:05.321596 run patchelf(pid=5875): Terminating (SIGINT) 07:11:05.501524 run patchelf(pid=5875): Terminated: ok {rc=0} 07:11:05.631059 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5872): Process ended prematurely: osmo-stp_10.42.42.5(pid=5872) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5872)] [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 07:11:05.640707 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:11:05.669082 run osmo-hlr_10.42.42.2(pid=5869): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5869)] 07:11:05.719617 run osmo-hlr_10.42.42.2(pid=5869): stdout: | (launched: 2022-12-09_07:11:02.279146) 07:11:05.771703 run osmo-hlr_10.42.42.2(pid=5869): stderr: | 20221209071102475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071102475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071102475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071102475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071102475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071102475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071102487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071102498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071102498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071102498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:05.824342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5868): Terminating (SIGTERM) 07:11:05.866468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5871): Terminating (SIGTERM) 07:11:05.908550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5874): Terminating (SIGTERM) 07:11:05.951497 --- ParallelTerminationStrategy: PID 5868 died... 07:11:05.972113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5868): Terminated: ok {rc=0} 07:11:06.018828 --- ParallelTerminationStrategy: PID 5871 died... 07:11:06.038839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5871): Terminated: ok {rc=0} 07:11:06.085390 --- ParallelTerminationStrategy: PID 5874 died... 07:11:06.105371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5874): Terminated: ok {rc=0} 07:11:06.193052 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:11:07.488667 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:11:07.496177 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:11:07.517988 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:11:07.557735 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:11:07.648484 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:11:07.670249 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:11:07.709999 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:11:08.306779 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:11:08.359556 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:08.371095 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:11:08.430185 tst cs_paging_gprs_active.py: using LAC 19792 07:11:08.559233 tst cs_paging_gprs_active.py: using RAC 157 07:11:08.688118 tst cs_paging_gprs_active.py: using CellId 19792 07:11:08.817697 tst cs_paging_gprs_active.py: using BVCI 19793 07:11:08.938749 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:08.950254 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:08.961461 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:08.972643 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:08.983737 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:08.994929 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:09.006245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:09.017324 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:09.028710 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:09.151068 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:09.269127 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:11:09.476449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:09.786831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5880): Launched 07:11:10.056011 run iperf3-srv_10.42.42.10(pid=5881): Launched 07:11:10.173922 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:11:10.380866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:10.697617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5882): Launched 07:11:10.985623 run iperf3-srv_10.42.42.10(pid=5883): Launched 07:11:11.109280 tst cs_paging_gprs_active.py:38: start network... 07:11:11.331367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:11.842922 run create_hlr_db(pid=5884): Launched 07:11:11.977078 bus /gobi_6: Setting Powered False 07:11:13.041638 run create_hlr_db(pid=5884): Terminated: ok {rc=0} 07:11:13.481069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5886): Launched 07:11:13.789985 run osmo-hlr_10.42.42.2(pid=5887): Launched 07:11:13.906441 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:14.440320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5889): Launched 07:11:14.751003 run osmo-stp_10.42.42.5(pid=5890): Launched 07:11:14.870981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:15.404038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5892): Launched 07:11:15.521760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:15.783541 run patchelf(pid=5893): Launched 07:11:15.985122 run osmo-stp_10.42.42.5(pid=5890): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5890)] 07:11:16.121298 run osmo-stp_10.42.42.5(pid=5890): stdout: | (launched: 2022-12-09_07:11:14.693308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:16.257546 run osmo-stp_10.42.42.5(pid=5890): stderr: | 20221209071114861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071114861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071114862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071114862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071114863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071114863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071114863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:16.393753 run osmo-stp_10.42.42.5(pid=5890): stdout: | (launched: 2022-12-09_07:11:14.693308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:16.524771 run osmo-stp_10.42.42.5(pid=5890): stderr: | 20221209071114861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071114861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071114862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071114862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071114863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071114863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071114863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:16.679258 run patchelf(pid=5893): Terminating (SIGINT) 07:11:16.855989 run patchelf(pid=5893): Terminated: ok {rc=0} 07:11:16.984562 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5890): Process ended prematurely: osmo-stp_10.42.42.5(pid=5890) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5890)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:11:16.995396 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:11:17.026208 run osmo-hlr_10.42.42.2(pid=5887): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5887)] 07:11:17.077207 run osmo-hlr_10.42.42.2(pid=5887): stdout: | (launched: 2022-12-09_07:11:13.732710) 07:11:17.129661 run osmo-hlr_10.42.42.2(pid=5887): stderr: | 20221209071113906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071113906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071113906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071113906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071113906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071113906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071113919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071113930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071113931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071113931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:17.182793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5880): Terminating (SIGTERM) 07:11:17.225450 run iperf3-srv_10.42.42.10(pid=5881): Terminating (SIGTERM) 07:11:17.267830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5882): Terminating (SIGTERM) 07:11:17.309986 run iperf3-srv_10.42.42.10(pid=5883): Terminating (SIGTERM) 07:11:17.350018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5886): Terminating (SIGTERM) 07:11:17.390267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5889): Terminating (SIGTERM) 07:11:17.430592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5892): Terminating (SIGTERM) 07:11:17.470838 --- ParallelTerminationStrategy: PID 5880 died... 07:11:17.489806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5880): Terminated: ok {rc=0} 07:11:17.534450 --- ParallelTerminationStrategy: PID 5881 died... 07:11:17.553010 run iperf3-srv_10.42.42.10(pid=5881): Terminated {rc=256} 07:11:17.597253 --- ParallelTerminationStrategy: PID 5882 died... 07:11:17.615733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5882): Terminated: ok {rc=0} 07:11:17.660202 --- ParallelTerminationStrategy: PID 5883 died... 07:11:17.678878 run iperf3-srv_10.42.42.10(pid=5883): Terminated {rc=256} 07:11:17.723135 --- ParallelTerminationStrategy: PID 5886 died... 07:11:17.741858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5886): Terminated: ok {rc=0} 07:11:17.786137 --- ParallelTerminationStrategy: PID 5889 died... 07:11:17.804859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5889): Terminated: ok {rc=0} 07:11:17.849103 --- ParallelTerminationStrategy: PID 5892 died... 07:11:17.867685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5892): Terminated: ok {rc=0} 07:11:17.955771 bus /gobi_0: Setting Powered False 07:11:19.056364 bus /gobi_0: Setting Powered False 07:11:20.172658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:11:21.320687 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.332577 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:11:21.392365 tst iperf3.py: using LAC 19793 07:11:21.513860 tst iperf3.py: using RAC 158 07:11:21.634142 tst iperf3.py: using CellId 19793 07:11:21.754809 tst iperf3.py: using BVCI 19794 07:11:21.867761 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.878975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.890093 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.901164 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.911959 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.922791 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.933948 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.944801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:21.955985 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:22.076781 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:11:22.300843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:22.633933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5894): Launched 07:11:22.922688 run iperf3-srv_10.42.42.10(pid=5895): Launched 07:11:23.046472 tst iperf3.py:8: start network... 07:11:23.269664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:23.780426 run create_hlr_db(pid=5896): Launched 07:11:23.913754 bus /gobi_6: Setting Powered False 07:11:24.974269 run create_hlr_db(pid=5896): Terminated: ok {rc=0} 07:11:25.434825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5898): Launched 07:11:25.764427 run osmo-hlr_10.42.42.2(pid=5899): Launched 07:11:25.889777 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:26.456430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5901): Launched 07:11:26.786892 run osmo-stp_10.42.42.5(pid=5902): Launched 07:11:26.913411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:27.482804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5904): Launched 07:11:27.608082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:27.887317 run patchelf(pid=5905): Launched 07:11:28.071727 run osmo-stp_10.42.42.5(pid=5902): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5902)] 07:11:28.211200 run osmo-stp_10.42.42.5(pid=5902): stdout: | (launched: 2022-12-09_07:11:26.726307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:28.352033 run osmo-stp_10.42.42.5(pid=5902): stderr: | 20221209071126916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071126917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071126917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071126917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071126918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071126918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071126918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:28.492497 run osmo-stp_10.42.42.5(pid=5902): stdout: | (launched: 2022-12-09_07:11:26.726307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:28.627797 run osmo-stp_10.42.42.5(pid=5902): stderr: | 20221209071126916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071126917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071126917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071126917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071126918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071126918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071126918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:28.787668 run patchelf(pid=5905): Terminating (SIGINT) 07:11:28.970759 run patchelf(pid=5905): Terminated: ok {rc=0} 07:11:29.103333 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5902): Process ended prematurely: osmo-stp_10.42.42.5(pid=5902) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5902)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 07:11:29.113871 tst iperf3.py:8: Test FAILED (7.8 sec) 07:11:29.142785 run osmo-hlr_10.42.42.2(pid=5899): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5899)] 07:11:29.193587 run osmo-hlr_10.42.42.2(pid=5899): stdout: | (launched: 2022-12-09_07:11:25.703985) 07:11:29.246017 run osmo-hlr_10.42.42.2(pid=5899): stderr: | 20221209071125899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071125899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071125899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071125899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071125899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071125899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071125912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071125921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071125921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071125921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:29.299100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5894): Terminating (SIGTERM) 07:11:29.342954 run iperf3-srv_10.42.42.10(pid=5895): Terminating (SIGTERM) 07:11:29.385480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5898): Terminating (SIGTERM) 07:11:29.428131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5901): Terminating (SIGTERM) 07:11:29.470666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5904): Terminating (SIGTERM) 07:11:29.513340 --- ParallelTerminationStrategy: PID 5894 died... 07:11:29.533686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5894): Terminated: ok {rc=0} 07:11:29.580598 --- ParallelTerminationStrategy: PID 5895 died... 07:11:29.600456 run iperf3-srv_10.42.42.10(pid=5895): Terminated {rc=256} 07:11:29.646932 --- ParallelTerminationStrategy: PID 5898 died... 07:11:29.666800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5898): Terminated: ok {rc=0} 07:11:29.713563 --- ParallelTerminationStrategy: PID 5901 died... 07:11:29.733426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5901): Terminated: ok {rc=0} 07:11:29.779948 --- ParallelTerminationStrategy: PID 5904 died... 07:11:29.799879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5904): Terminated: ok {rc=0} 07:11:29.889436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:11:31.043579 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.056600 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:11:31.115735 tst iperf3m4.py: using LAC 19794 07:11:31.239598 tst iperf3m4.py: using RAC 159 07:11:31.371724 tst iperf3m4.py: using CellId 19794 07:11:31.502172 tst iperf3m4.py: using BVCI 19795 07:11:31.644722 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.657698 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.670364 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.682716 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.694879 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.707064 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.719927 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.732852 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:31.745221 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:31.868618 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:31.997809 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:32.122735 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:32.247569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:11:32.456778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:32.769039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5906): Launched 07:11:33.039201 run iperf3-srv_10.42.42.10(pid=5907): Launched 07:11:33.155289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:11:33.362210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:33.672358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5908): Launched 07:11:33.940934 run iperf3-srv_10.42.42.10(pid=5909): Launched 07:11:34.056550 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:11:34.263897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:34.574352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5910): Launched 07:11:34.844842 run iperf3-srv_10.42.42.10(pid=5911): Launched 07:11:34.960125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:11:35.166342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:35.475216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Launched 07:11:35.742852 run iperf3-srv_10.42.42.10(pid=5913): Launched 07:11:35.859560 tst iperf3m4.py:8: start network... 07:11:36.065482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:36.541612 run create_hlr_db(pid=5914): Launched 07:11:36.658427 bus /gobi_6: Setting Powered False 07:11:37.719512 run create_hlr_db(pid=5914): Terminated: ok {rc=0} 07:11:38.148239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5916): Launched 07:11:38.456195 run osmo-hlr_10.42.42.2(pid=5917): Launched 07:11:38.573862 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:39.109095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5919): Launched 07:11:39.417512 run osmo-stp_10.42.42.5(pid=5920): Launched 07:11:39.534644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:40.064629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5922): Launched 07:11:40.182442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:40.444519 run patchelf(pid=5923): Launched 07:11:40.616373 run osmo-stp_10.42.42.5(pid=5920): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5920)] 07:11:40.747775 run osmo-stp_10.42.42.5(pid=5920): stdout: | (launched: 2022-12-09_07:11:39.360277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:40.879660 run osmo-stp_10.42.42.5(pid=5920): stderr: | 20221209071139529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071139529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071139530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071139530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071139530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071139531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071139531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:41.012059 run osmo-stp_10.42.42.5(pid=5920): stdout: | (launched: 2022-12-09_07:11:39.360277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:41.139249 run osmo-stp_10.42.42.5(pid=5920): stderr: | 20221209071139529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071139529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071139530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071139530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071139530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071139531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071139531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:41.289505 run patchelf(pid=5923): Terminating (SIGINT) 07:11:41.462455 run patchelf(pid=5923): Terminated: ok {rc=0} 07:11:41.586689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5920): Process ended prematurely: osmo-stp_10.42.42.5(pid=5920) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5920)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:11:41.596221 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:11:41.623940 run osmo-hlr_10.42.42.2(pid=5917): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5917)] 07:11:41.672557 run osmo-hlr_10.42.42.2(pid=5917): stdout: | (launched: 2022-12-09_07:11:38.399099) 07:11:41.722257 run osmo-hlr_10.42.42.2(pid=5917): stderr: | 20221209071138574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071138574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071138574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071138574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071138575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071138575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071138587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071138598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071138598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071138598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:41.772734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5906): Terminating (SIGTERM) 07:11:41.812883 run iperf3-srv_10.42.42.10(pid=5907): Terminating (SIGTERM) 07:11:41.853043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5908): Terminating (SIGTERM) 07:11:41.893514 run iperf3-srv_10.42.42.10(pid=5909): Terminating (SIGTERM) 07:11:41.933491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5910): Terminating (SIGTERM) 07:11:41.973581 run iperf3-srv_10.42.42.10(pid=5911): Terminating (SIGTERM) 07:11:42.013630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Terminating (SIGTERM) 07:11:42.053865 run iperf3-srv_10.42.42.10(pid=5913): Terminating (SIGTERM) 07:11:42.093935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5916): Terminating (SIGTERM) 07:11:42.134128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5919): Terminating (SIGTERM) 07:11:42.174218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5922): Terminating (SIGTERM) 07:11:42.214671 --- ParallelTerminationStrategy: PID 5906 died... 07:11:42.233817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5906): Terminated: ok {rc=0} 07:11:42.278736 --- ParallelTerminationStrategy: PID 5907 died... 07:11:42.297518 run iperf3-srv_10.42.42.10(pid=5907): Terminated {rc=256} 07:11:42.341750 --- ParallelTerminationStrategy: PID 5908 died... 07:11:42.360496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5908): Terminated: ok {rc=0} 07:11:42.404897 --- ParallelTerminationStrategy: PID 5909 died... 07:11:42.423889 run iperf3-srv_10.42.42.10(pid=5909): Terminated {rc=256} 07:11:42.468226 --- ParallelTerminationStrategy: PID 5910 died... 07:11:42.486918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5910): Terminated: ok {rc=0} 07:11:42.531203 --- ParallelTerminationStrategy: PID 5911 died... 07:11:42.549790 run iperf3-srv_10.42.42.10(pid=5911): Terminated {rc=256} 07:11:42.594154 --- ParallelTerminationStrategy: PID 5912 died... 07:11:42.612820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Terminated: ok {rc=0} 07:11:42.657574 --- ParallelTerminationStrategy: PID 5913 died... 07:11:42.676223 run iperf3-srv_10.42.42.10(pid=5913): Terminated {rc=256} 07:11:42.720580 --- ParallelTerminationStrategy: PID 5916 died... 07:11:42.739372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5916): Terminated: ok {rc=0} 07:11:42.783761 --- ParallelTerminationStrategy: PID 5919 died... 07:11:42.802542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5919): Terminated: ok {rc=0} 07:11:42.847152 --- ParallelTerminationStrategy: PID 5922 died... 07:11:42.865922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5922): Terminated: ok {rc=0} 07:11:42.951238 bus /gobi_4: Setting Powered False 07:11:44.051595 bus /gobi_4: Setting Powered False 07:11:45.167287 bus /gobi_1: Setting Powered False 07:11:46.265738 bus /gobi_1: Setting Powered False 07:11:47.384022 bus /gobi_0: Setting Powered False 07:11:48.482232 bus /gobi_0: Setting Powered False 07:11:49.599547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:11:50.703205 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:50.715040 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:11:50.773474 tst ping.py: using LAC 19795 07:11:50.893639 tst ping.py: using RAC 160 07:11:51.027354 tst ping.py: using CellId 19795 07:11:51.154608 tst ping.py: using BVCI 19796 07:11:51.272785 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.284472 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.296020 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.308076 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.319951 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.331624 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.343514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:51.355237 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:51.476343 tst ping.py:19: start network... 07:11:51.694225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:52.196639 run create_hlr_db(pid=5924): Launched 07:11:52.328171 bus /gobi_6: Setting Powered False 07:11:53.392218 run create_hlr_db(pid=5924): Terminated: ok {rc=0} 07:11:53.825976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5926): Launched 07:11:54.128499 run osmo-hlr_10.42.42.2(pid=5927): Launched 07:11:54.244292 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:54.778055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5929): Launched 07:11:55.080794 run osmo-stp_10.42.42.5(pid=5930): Launched 07:11:55.195801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:55.733610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5932): Launched 07:11:55.850354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:56.107337 run patchelf(pid=5933): Launched 07:11:56.276411 run osmo-stp_10.42.42.5(pid=5930): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5930)] 07:11:56.405144 run osmo-stp_10.42.42.5(pid=5930): stdout: | (launched: 2022-12-09_07:11:55.023951) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:56.535630 run osmo-stp_10.42.42.5(pid=5930): stderr: | 20221209071155194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071155194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071155195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071155195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071155196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071155196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071155196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:56.666063 run osmo-stp_10.42.42.5(pid=5930): stdout: | (launched: 2022-12-09_07:11:55.023951) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:56.791447 run osmo-stp_10.42.42.5(pid=5930): stderr: | 20221209071155194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071155194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071155195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071155195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071155196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071155196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071155196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:56.938902 run patchelf(pid=5933): Terminating (SIGINT) 07:11:57.107801 run patchelf(pid=5933): Terminated: ok {rc=0} 07:11:57.230121 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5930): Process ended prematurely: osmo-stp_10.42.42.5(pid=5930) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5930)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 07:11:57.239126 tst ping.py:22: Test FAILED (6.5 sec) 07:11:57.266642 run osmo-hlr_10.42.42.2(pid=5927): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5927)] 07:11:57.315461 run osmo-hlr_10.42.42.2(pid=5927): stdout: | (launched: 2022-12-09_07:11:54.072075) 07:11:57.365663 run osmo-hlr_10.42.42.2(pid=5927): stderr: | 20221209071154245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071154245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071154246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071154246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071154246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071154246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071154258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071154269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071154269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071154269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:57.416357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5926): Terminating (SIGTERM) 07:11:57.457254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5929): Terminating (SIGTERM) 07:11:57.498180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5932): Terminating (SIGTERM) 07:11:57.539219 --- ParallelTerminationStrategy: PID 5926 died... 07:11:57.558636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5926): Terminated: ok {rc=0} 07:11:57.603970 --- ParallelTerminationStrategy: PID 5929 died... 07:11:57.622949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5929): Terminated: ok {rc=0} 07:11:57.667855 --- ParallelTerminationStrategy: PID 5932 died... 07:11:57.686850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5932): Terminated: ok {rc=0} 07:11:57.773794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:11:58.863511 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:58.875741 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:11:58.934250 tst ping_idle_ping.py: using LAC 19796 07:11:59.054566 tst ping_idle_ping.py: using RAC 161 07:11:59.175304 tst ping_idle_ping.py: using CellId 19796 07:11:59.296308 tst ping_idle_ping.py: using BVCI 19797 07:11:59.407208 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.418295 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.429084 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.440434 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.451595 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.462701 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.474111 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:11:59.485454 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:11:59.601668 tst ping_idle_ping.py:24: start network... 07:11:59.804662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:00.279088 run create_hlr_db(pid=5934): Launched 07:12:00.394855 bus /gobi_6: Setting Powered False 07:12:01.453740 run create_hlr_db(pid=5934): Terminated: ok {rc=0} 07:12:01.891951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5936): Launched 07:12:02.211715 run osmo-hlr_10.42.42.2(pid=5937): Launched 07:12:02.328517 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:02.852172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5939): Launched 07:12:03.158051 run osmo-stp_10.42.42.5(pid=5940): Launched 07:12:03.276540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:03.802746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5942): Launched 07:12:03.920628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:04.178720 run patchelf(pid=5943): Launched 07:12:04.350239 run osmo-stp_10.42.42.5(pid=5940): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5940)] 07:12:04.479100 run osmo-stp_10.42.42.5(pid=5940): stdout: | (launched: 2022-12-09_07:12:03.101349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:04.609417 run osmo-stp_10.42.42.5(pid=5940): stderr: | 20221209071203270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071203270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071203270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071203271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071203271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071203271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071203271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:04.740448 run osmo-stp_10.42.42.5(pid=5940): stdout: | (launched: 2022-12-09_07:12:03.101349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:04.865646 run osmo-stp_10.42.42.5(pid=5940): stderr: | 20221209071203270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071203270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071203270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071203271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071203271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071203271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071203271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:05.013762 run patchelf(pid=5943): Terminating (SIGINT) 07:12:05.183714 run patchelf(pid=5943): Terminated: ok {rc=0} 07:12:05.306157 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5940): Process ended prematurely: osmo-stp_10.42.42.5(pid=5940) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5940)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:12:05.315018 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:12:05.342789 run osmo-hlr_10.42.42.2(pid=5937): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5937)] 07:12:05.391505 run osmo-hlr_10.42.42.2(pid=5937): stdout: | (launched: 2022-12-09_07:12:02.155103) 07:12:05.442448 run osmo-hlr_10.42.42.2(pid=5937): stderr: | 20221209071202327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071202327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071202327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071202327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071202327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071202328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071202342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071202352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071202353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071202353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:05.494018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5936): Terminating (SIGTERM) 07:12:05.535170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5939): Terminating (SIGTERM) 07:12:05.576223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5942): Terminating (SIGTERM) 07:12:05.617960 --- ParallelTerminationStrategy: PID 5936 died... 07:12:05.637960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5936): Terminated: ok {rc=0} 07:12:05.683241 --- ParallelTerminationStrategy: PID 5939 died... 07:12:05.702307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5939): Terminated: ok {rc=0} 07:12:05.747503 --- ParallelTerminationStrategy: PID 5942 died... 07:12:05.766597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5942): Terminated: ok {rc=0} 07:12:05.852590 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:12:07.156611 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:07.163202 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:12:07.185084 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:12:07.225174 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:12:07.314433 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:12:07.335964 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:12:07.376085 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:12:07.977180 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:12:08.030275 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.041898 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:12:08.099716 tst cs_paging_gprs_active.py: using LAC 19797 07:12:08.226356 tst cs_paging_gprs_active.py: using RAC 162 07:12:08.353710 tst cs_paging_gprs_active.py: using CellId 19797 07:12:08.481354 tst cs_paging_gprs_active.py: using BVCI 19798 07:12:08.601822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.613461 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.624749 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.636134 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.647524 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.658783 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.670312 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.681611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:08.693141 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:08.812079 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:08.933150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:12:09.157170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:09.488526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5947): Launched 07:12:09.775352 run iperf3-srv_10.42.42.10(pid=5948): Launched 07:12:09.900081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:12:10.122832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:10.454810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5949): Launched 07:12:10.741529 run iperf3-srv_10.42.42.10(pid=5950): Launched 07:12:10.863967 tst cs_paging_gprs_active.py:38: start network... 07:12:11.085826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:11.595173 run create_hlr_db(pid=5951): Launched 07:12:11.730027 bus /gobi_6: Setting Powered False 07:12:12.794684 run create_hlr_db(pid=5951): Terminated: ok {rc=0} 07:12:13.235060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5953): Launched 07:12:13.544571 run osmo-hlr_10.42.42.2(pid=5954): Launched 07:12:13.662938 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:14.209249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5956): Launched 07:12:14.518232 run osmo-stp_10.42.42.5(pid=5957): Launched 07:12:14.636291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:15.169679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5959): Launched 07:12:15.287249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:15.548612 run patchelf(pid=5960): Launched 07:12:15.720082 run osmo-stp_10.42.42.5(pid=5957): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5957)] 07:12:15.856079 run osmo-stp_10.42.42.5(pid=5957): stdout: | (launched: 2022-12-09_07:12:14.460903) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:15.997171 run osmo-stp_10.42.42.5(pid=5957): stderr: | 20221209071214631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071214631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071214631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071214631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071214632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071214632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071214632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:16.133203 run osmo-stp_10.42.42.5(pid=5957): stdout: | (launched: 2022-12-09_07:12:14.460903) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:16.264002 run osmo-stp_10.42.42.5(pid=5957): stderr: | 20221209071214631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071214631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071214631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071214631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071214632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071214632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071214632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:16.418513 run patchelf(pid=5960): Terminating (SIGINT) 07:12:16.595817 run patchelf(pid=5960): Terminated: ok {rc=0} 07:12:16.723587 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5957): Process ended prematurely: osmo-stp_10.42.42.5(pid=5957) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5957)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:12:16.734379 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:12:16.765168 run osmo-hlr_10.42.42.2(pid=5954): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5954)] 07:12:16.815711 run osmo-hlr_10.42.42.2(pid=5954): stdout: | (launched: 2022-12-09_07:12:13.486492) 07:12:16.867944 run osmo-hlr_10.42.42.2(pid=5954): stderr: | 20221209071213660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071213660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071213660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071213660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071213660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071213660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071213672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071213680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071213680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071213680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:16.920922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5947): Terminating (SIGTERM) 07:12:16.964108 run iperf3-srv_10.42.42.10(pid=5948): Terminating (SIGTERM) 07:12:17.008249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5949): Terminating (SIGTERM) 07:12:17.051535 run iperf3-srv_10.42.42.10(pid=5950): Terminating (SIGTERM) 07:12:17.096762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5953): Terminating (SIGTERM) 07:12:17.139552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5956): Terminating (SIGTERM) 07:12:17.181983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5959): Terminating (SIGTERM) 07:12:17.224479 --- ParallelTerminationStrategy: PID 5947 died... 07:12:17.244085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5947): Terminated: ok {rc=0} 07:12:17.291520 --- ParallelTerminationStrategy: PID 5948 died... 07:12:17.311489 run iperf3-srv_10.42.42.10(pid=5948): Terminated {rc=256} 07:12:17.355629 --- ParallelTerminationStrategy: PID 5949 died... 07:12:17.374140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5949): Terminated: ok {rc=0} 07:12:17.418970 --- ParallelTerminationStrategy: PID 5950 died... 07:12:17.437434 run iperf3-srv_10.42.42.10(pid=5950): Terminated {rc=256} 07:12:17.482246 --- ParallelTerminationStrategy: PID 5953 died... 07:12:17.500865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5953): Terminated: ok {rc=0} 07:12:17.545327 --- ParallelTerminationStrategy: PID 5956 died... 07:12:17.563848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5956): Terminated: ok {rc=0} 07:12:17.608067 --- ParallelTerminationStrategy: PID 5959 died... 07:12:17.626726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5959): Terminated: ok {rc=0} 07:12:17.713129 bus /gobi_0: Setting Powered False 07:12:18.814521 bus /gobi_0: Setting Powered False 07:12:19.930861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:12:21.078602 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.090320 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:12:21.150192 tst iperf3.py: using LAC 19798 07:12:21.273040 tst iperf3.py: using RAC 163 07:12:21.393216 tst iperf3.py: using CellId 19798 07:12:21.513942 tst iperf3.py: using BVCI 19799 07:12:21.625496 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.636386 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.647182 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.658199 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.669220 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.680113 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.691326 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.702241 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:21.713432 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:21.830259 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:12:22.037823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:22.347385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Launched 07:12:22.616214 run iperf3-srv_10.42.42.10(pid=5962): Launched 07:12:22.731260 tst iperf3.py:8: start network... 07:12:22.937252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:23.414760 run create_hlr_db(pid=5963): Launched 07:12:23.534764 bus /gobi_6: Setting Powered False 07:12:24.594771 run create_hlr_db(pid=5963): Terminated: ok {rc=0} 07:12:25.045637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5965): Launched 07:12:25.376577 run osmo-hlr_10.42.42.2(pid=5966): Launched 07:12:25.501937 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:26.070969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5968): Launched 07:12:26.403451 run osmo-stp_10.42.42.5(pid=5969): Launched 07:12:26.527903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:27.096505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5971): Launched 07:12:27.222227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:27.500656 run patchelf(pid=5972): Launched 07:12:27.684704 run osmo-stp_10.42.42.5(pid=5969): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5969)] 07:12:27.823818 run osmo-stp_10.42.42.5(pid=5969): stdout: | (launched: 2022-12-09_07:12:26.342578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:27.964760 run osmo-stp_10.42.42.5(pid=5969): stderr: | 20221209071226534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071226534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071226534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071226535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071226535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071226535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071226535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:28.105611 run osmo-stp_10.42.42.5(pid=5969): stdout: | (launched: 2022-12-09_07:12:26.342578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:28.240807 run osmo-stp_10.42.42.5(pid=5969): stderr: | 20221209071226534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071226534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071226534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071226535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071226535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071226535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071226535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:28.400831 run patchelf(pid=5972): Terminating (SIGINT) 07:12:28.584849 run patchelf(pid=5972): Terminated: ok {rc=0} 07:12:28.717469 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5969): Process ended prematurely: osmo-stp_10.42.42.5(pid=5969) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5969)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 07:12:28.727922 tst iperf3.py:8: Test FAILED (7.7 sec) 07:12:28.756714 run osmo-hlr_10.42.42.2(pid=5966): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5966)] 07:12:28.807451 run osmo-hlr_10.42.42.2(pid=5966): stdout: | (launched: 2022-12-09_07:12:25.315716) 07:12:28.860001 run osmo-hlr_10.42.42.2(pid=5966): stderr: | 20221209071225513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071225513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071225513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071225513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071225513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071225513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071225526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071225535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071225535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071225535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:28.912396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Terminating (SIGTERM) 07:12:28.954742 run iperf3-srv_10.42.42.10(pid=5962): Terminating (SIGTERM) 07:12:28.996803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5965): Terminating (SIGTERM) 07:12:29.039532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5968): Terminating (SIGTERM) 07:12:29.082322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5971): Terminating (SIGTERM) 07:12:29.125000 --- ParallelTerminationStrategy: PID 5961 died... 07:12:29.145390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Terminated: ok {rc=0} 07:12:29.192471 --- ParallelTerminationStrategy: PID 5962 died... 07:12:29.212247 run iperf3-srv_10.42.42.10(pid=5962): Terminated {rc=256} 07:12:29.258673 --- ParallelTerminationStrategy: PID 5965 died... 07:12:29.278430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5965): Terminated: ok {rc=0} 07:12:29.324866 --- ParallelTerminationStrategy: PID 5968 died... 07:12:29.345119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5968): Terminated: ok {rc=0} 07:12:29.391442 --- ParallelTerminationStrategy: PID 5971 died... 07:12:29.411262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5971): Terminated: ok {rc=0} 07:12:29.499885 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:12:30.652669 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:30.665007 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:12:30.729636 tst iperf3m4.py: using LAC 19799 07:12:30.862147 tst iperf3m4.py: using RAC 164 07:12:31.000207 tst iperf3m4.py: using CellId 19799 07:12:31.129559 tst iperf3m4.py: using BVCI 19800 07:12:31.246008 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.258151 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.270095 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.283143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.297227 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.309030 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.322150 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.336180 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:31.349571 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:31.493806 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:31.636193 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:31.787676 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:31.941277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:12:32.208238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:32.541481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5973): Launched 07:12:32.827801 run iperf3-srv_10.42.42.10(pid=5974): Launched 07:12:32.952189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:12:33.174691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:33.505457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5975): Launched 07:12:33.791381 run iperf3-srv_10.42.42.10(pid=5976): Launched 07:12:33.914231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:12:34.136081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:34.467419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5977): Launched 07:12:34.754713 run iperf3-srv_10.42.42.10(pid=5978): Launched 07:12:34.877445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:12:35.099736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:35.430611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5979): Launched 07:12:35.716246 run iperf3-srv_10.42.42.10(pid=5980): Launched 07:12:35.841789 tst iperf3m4.py:8: start network... 07:12:36.048212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:36.524692 run create_hlr_db(pid=5983): Launched 07:12:36.641852 bus /gobi_6: Setting Powered False 07:12:37.703169 run create_hlr_db(pid=5983): Terminated: ok {rc=0} 07:12:38.153258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5985): Launched 07:12:38.483215 run osmo-hlr_10.42.42.2(pid=5986): Launched 07:12:38.608033 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:39.177308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5988): Launched 07:12:39.507352 run osmo-stp_10.42.42.5(pid=5989): Launched 07:12:39.633544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:40.201175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5991): Launched 07:12:40.326505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:40.606378 run patchelf(pid=5992): Launched 07:12:40.788786 run osmo-stp_10.42.42.5(pid=5989): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5989)] 07:12:40.927796 run osmo-stp_10.42.42.5(pid=5989): stdout: | (launched: 2022-12-09_07:12:39.446509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:41.069223 run osmo-stp_10.42.42.5(pid=5989): stderr: | 20221209071239636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071239636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071239636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071239637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071239637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071239637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071239637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:41.211450 run osmo-stp_10.42.42.5(pid=5989): stdout: | (launched: 2022-12-09_07:12:39.446509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:41.346495 run osmo-stp_10.42.42.5(pid=5989): stderr: | 20221209071239636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071239636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071239636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071239637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071239637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071239637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071239637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:41.506270 run patchelf(pid=5992): Terminating (SIGINT) 07:12:41.689357 run patchelf(pid=5992): Terminated: ok {rc=0} 07:12:41.821158 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5989): Process ended prematurely: osmo-stp_10.42.42.5(pid=5989) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5989)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:12:41.831534 tst iperf3m4.py:8: Test FAILED (11.2 sec) 07:12:41.860382 run osmo-hlr_10.42.42.2(pid=5986): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5986)] 07:12:41.911066 run osmo-hlr_10.42.42.2(pid=5986): stdout: | (launched: 2022-12-09_07:12:38.422105) 07:12:41.963526 run osmo-hlr_10.42.42.2(pid=5986): stderr: | 20221209071238619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071238619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071238619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071238619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071238619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071238619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071238631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071238642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071238642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071238642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:42.016401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5973): Terminating (SIGTERM) 07:12:42.058802 run iperf3-srv_10.42.42.10(pid=5974): Terminating (SIGTERM) 07:12:42.101492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5975): Terminating (SIGTERM) 07:12:42.143798 run iperf3-srv_10.42.42.10(pid=5976): Terminating (SIGTERM) 07:12:42.185938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5977): Terminating (SIGTERM) 07:12:42.228148 run iperf3-srv_10.42.42.10(pid=5978): Terminating (SIGTERM) 07:12:42.270181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5979): Terminating (SIGTERM) 07:12:42.312307 run iperf3-srv_10.42.42.10(pid=5980): Terminating (SIGTERM) 07:12:42.354446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5985): Terminating (SIGTERM) 07:12:42.396687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5988): Terminating (SIGTERM) 07:12:42.438778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5991): Terminating (SIGTERM) 07:12:42.481096 --- ParallelTerminationStrategy: PID 5973 died... 07:12:42.501109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5973): Terminated: ok {rc=0} 07:12:42.547691 --- ParallelTerminationStrategy: PID 5974 died... 07:12:42.567247 run iperf3-srv_10.42.42.10(pid=5974): Terminated {rc=256} 07:12:42.613423 --- ParallelTerminationStrategy: PID 5975 died... 07:12:42.633154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5975): Terminated: ok {rc=0} 07:12:42.679416 --- ParallelTerminationStrategy: PID 5976 died... 07:12:42.699113 run iperf3-srv_10.42.42.10(pid=5976): Terminated {rc=256} 07:12:42.745368 --- ParallelTerminationStrategy: PID 5977 died... 07:12:42.764874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5977): Terminated: ok {rc=0} 07:12:42.811411 --- ParallelTerminationStrategy: PID 5978 died... 07:12:42.831200 run iperf3-srv_10.42.42.10(pid=5978): Terminated {rc=256} 07:12:42.877281 --- ParallelTerminationStrategy: PID 5979 died... 07:12:42.896880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5979): Terminated: ok {rc=0} 07:12:42.943396 --- ParallelTerminationStrategy: PID 5980 died... 07:12:42.963138 run iperf3-srv_10.42.42.10(pid=5980): Terminated {rc=256} 07:12:43.009245 --- ParallelTerminationStrategy: PID 5985 died... 07:12:43.028908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5985): Terminated: ok {rc=0} 07:12:43.075553 --- ParallelTerminationStrategy: PID 5988 died... 07:12:43.095809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5988): Terminated: ok {rc=0} 07:12:43.142806 --- ParallelTerminationStrategy: PID 5991 died... 07:12:43.162745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5991): Terminated: ok {rc=0} 07:12:43.251246 bus /gobi_4: Setting Powered False 07:12:44.352118 bus /gobi_4: Setting Powered False 07:12:45.469956 bus /gobi_1: Setting Powered False 07:12:46.575354 bus /gobi_1: Setting Powered False 07:12:47.702677 bus /gobi_0: Setting Powered False 07:12:48.798613 bus /gobi_0: Setting Powered False 07:12:49.914939 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:12:51.020786 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.033087 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:12:51.095647 tst ping.py: using LAC 19800 07:12:51.214503 tst ping.py: using RAC 165 07:12:51.331370 tst ping.py: using CellId 19800 07:12:51.467879 tst ping.py: using BVCI 19801 07:12:51.589475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.601178 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.612677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.624719 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.636613 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.648494 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.660642 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:51.672434 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:51.789430 tst ping.py:19: start network... 07:12:51.993655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:52.463738 run create_hlr_db(pid=5993): Launched 07:12:52.581205 bus /gobi_6: Setting Powered False 07:12:53.641346 run create_hlr_db(pid=5993): Terminated: ok {rc=0} 07:12:54.063608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5995): Launched 07:12:54.367775 run osmo-hlr_10.42.42.2(pid=5996): Launched 07:12:54.483706 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:55.018313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5998): Launched 07:12:55.323531 run osmo-stp_10.42.42.5(pid=5999): Launched 07:12:55.441504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:55.965642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6001): Launched 07:12:56.081623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:56.338439 run patchelf(pid=6002): Launched 07:12:56.508692 run osmo-stp_10.42.42.5(pid=5999): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5999)] 07:12:56.637108 run osmo-stp_10.42.42.5(pid=5999): stdout: | (launched: 2022-12-09_07:12:55.266605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:56.767176 run osmo-stp_10.42.42.5(pid=5999): stderr: | 20221209071255436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071255436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071255437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071255437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071255437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071255438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071255438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:56.896678 run osmo-stp_10.42.42.5(pid=5999): stdout: | (launched: 2022-12-09_07:12:55.266605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:57.021236 run osmo-stp_10.42.42.5(pid=5999): stderr: | 20221209071255436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071255436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071255437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071255437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071255437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071255438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071255438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:57.168578 run patchelf(pid=6002): Terminating (SIGINT) 07:12:57.338552 run patchelf(pid=6002): Terminated: ok {rc=0} 07:12:57.460670 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5999): Process ended prematurely: osmo-stp_10.42.42.5(pid=5999) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5999)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 07:12:57.469898 tst ping.py:22: Test FAILED (6.4 sec) 07:12:57.497486 run osmo-hlr_10.42.42.2(pid=5996): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5996)] 07:12:57.546383 run osmo-hlr_10.42.42.2(pid=5996): stdout: | (launched: 2022-12-09_07:12:54.310933) 07:12:57.596896 run osmo-hlr_10.42.42.2(pid=5996): stderr: | 20221209071254486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071254486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071254486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071254486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071254486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071254486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071254498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071254507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071254507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071254507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:57.647822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5995): Terminating (SIGTERM) 07:12:57.688768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5998): Terminating (SIGTERM) 07:12:57.729702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6001): Terminating (SIGTERM) 07:12:57.770812 --- ParallelTerminationStrategy: PID 5995 died... 07:12:57.790386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5995): Terminated: ok {rc=0} 07:12:57.835867 --- ParallelTerminationStrategy: PID 5998 died... 07:12:57.854816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5998): Terminated: ok {rc=0} 07:12:57.900072 --- ParallelTerminationStrategy: PID 6001 died... 07:12:57.919091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6001): Terminated: ok {rc=0} 07:12:58.006928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:12:59.097830 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.110240 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:12:59.173238 tst ping_idle_ping.py: using LAC 19801 07:12:59.294437 tst ping_idle_ping.py: using RAC 166 07:12:59.413379 tst ping_idle_ping.py: using CellId 19801 07:12:59.531153 tst ping_idle_ping.py: using BVCI 19802 07:12:59.641272 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.652408 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.663278 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.674543 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.685715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.696604 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.707825 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:12:59.718950 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:12:59.833862 tst ping_idle_ping.py:24: start network... 07:13:00.037229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:00.515733 run create_hlr_db(pid=6003): Launched 07:13:00.630880 bus /gobi_6: Setting Powered False 07:13:01.699939 run create_hlr_db(pid=6003): Terminated: ok {rc=0} 07:13:02.165701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Launched 07:13:02.499296 run osmo-hlr_10.42.42.2(pid=6006): Launched 07:13:02.624608 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:03.184264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Launched 07:13:03.509023 run osmo-stp_10.42.42.5(pid=6009): Launched 07:13:03.633491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:04.196199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6011): Launched 07:13:04.319429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:04.597821 run patchelf(pid=6012): Launched 07:13:04.783299 run osmo-stp_10.42.42.5(pid=6009): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6009)] 07:13:04.919622 run osmo-stp_10.42.42.5(pid=6009): stdout: | (launched: 2022-12-09_07:13:03.448664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:05.057499 run osmo-stp_10.42.42.5(pid=6009): stderr: | 20221209071303640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071303640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071303641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071303641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071303642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071303642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071303642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:05.195794 run osmo-stp_10.42.42.5(pid=6009): stdout: | (launched: 2022-12-09_07:13:03.448664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:05.328847 run osmo-stp_10.42.42.5(pid=6009): stderr: | 20221209071303640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071303640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071303641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071303641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071303642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071303642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071303642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:05.485694 run patchelf(pid=6012): Terminating (SIGINT) 07:13:05.665097 run patchelf(pid=6012): Terminated: ok {rc=0} 07:13:05.794614 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6009): Process ended prematurely: osmo-stp_10.42.42.5(pid=6009) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6009)] [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:13:05.804349 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:13:05.832386 run osmo-hlr_10.42.42.2(pid=6006): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6006)] 07:13:05.882291 run osmo-hlr_10.42.42.2(pid=6006): stdout: | (launched: 2022-12-09_07:13:02.439524) 07:13:05.933970 run osmo-hlr_10.42.42.2(pid=6006): stderr: | 20221209071302637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071302637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071302637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071302637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071302637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071302637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071302651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071302659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071302659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071302659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:05.985884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Terminating (SIGTERM) 07:13:06.027903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Terminating (SIGTERM) 07:13:06.069851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6011): Terminating (SIGTERM) 07:13:06.112452 --- ParallelTerminationStrategy: PID 6005 died... 07:13:06.132454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Terminated: ok {rc=0} 07:13:06.178650 --- ParallelTerminationStrategy: PID 6008 died... 07:13:06.198219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Terminated: ok {rc=0} 07:13:06.244305 --- ParallelTerminationStrategy: PID 6011 died... 07:13:06.264096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6011): Terminated: ok {rc=0} 07:13:06.351984 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:13:07.644018 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:07.650780 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:13:07.672032 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:13:07.707956 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:13:07.763438 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:13:07.784424 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:13:07.819650 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:13:08.375039 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:13:08.380041 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:08.391313 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:13:08.448682 tst switch_tch_pdch.py: using LAC 19802 07:13:08.569598 tst switch_tch_pdch.py: using RAC 167 07:13:08.698847 tst switch_tch_pdch.py: using CellId 19802 07:13:08.826960 tst switch_tch_pdch.py: using BVCI 19803 07:13:08.946183 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:08.958183 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:08.969936 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:08.981905 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:08.993854 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:09.005564 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:09.017426 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:13:09.029109 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:13:09.146301 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:13:09.267748 tst switch_tch_pdch.py:51: start network... 07:13:09.471446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:09.942314 run create_hlr_db(pid=6016): Launched 07:13:10.058847 bus /gobi_6: Setting Powered False 07:13:11.118396 run create_hlr_db(pid=6016): Terminated: ok {rc=0} 07:13:11.563015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6018): Launched 07:13:11.888506 run osmo-hlr_10.42.42.2(pid=6019): Launched 07:13:12.011693 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:12.569602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6021): Launched 07:13:12.893135 run osmo-stp_10.42.42.5(pid=6022): Launched 07:13:13.015966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:13.575358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6024): Launched 07:13:13.699653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:13.974050 run patchelf(pid=6025): Launched 07:13:14.154065 run osmo-stp_10.42.42.5(pid=6022): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6022)] 07:13:14.290591 run osmo-stp_10.42.42.5(pid=6022): stdout: | (launched: 2022-12-09_07:13:12.832781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:14.428250 run osmo-stp_10.42.42.5(pid=6022): stderr: | 20221209071313024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071313024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071313024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071313025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071313025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071313025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071313025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:14.566022 run osmo-stp_10.42.42.5(pid=6022): stdout: | (launched: 2022-12-09_07:13:12.832781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:14.698461 run osmo-stp_10.42.42.5(pid=6022): stderr: | 20221209071313024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071313024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071313024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071313025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071313025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071313025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071313025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:14.855405 run patchelf(pid=6025): Terminating (SIGINT) 07:13:15.034787 run patchelf(pid=6025): Terminated: ok {rc=0} 07:13:15.164880 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6022): Process ended prematurely: osmo-stp_10.42.42.5(pid=6022) [trial-2356↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6022)] [trial-2356↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:13:15.174640 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 07:13:15.202582 run osmo-hlr_10.42.42.2(pid=6019): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6019)] 07:13:15.252509 run osmo-hlr_10.42.42.2(pid=6019): stdout: | (launched: 2022-12-09_07:13:11.828036) 07:13:15.304070 run osmo-hlr_10.42.42.2(pid=6019): stderr: | 20221209071312026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071312026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071312026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071312026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071312027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071312027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071312043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071312053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071312053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071312053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:15.356118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6018): Terminating (SIGTERM) 07:13:15.398071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6021): Terminating (SIGTERM) 07:13:15.439995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6024): Terminating (SIGTERM) 07:13:15.482014 --- ParallelTerminationStrategy: PID 6018 died... 07:13:15.502011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6018): Terminated: ok {rc=0} 07:13:15.547941 --- ParallelTerminationStrategy: PID 6021 died... 07:13:15.567585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6021): Terminated: ok {rc=0} 07:13:15.613360 --- ParallelTerminationStrategy: PID 6024 died... 07:13:15.632704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6024): Terminated: ok {rc=0} 07:13:15.721155 bus /gobi_0: Setting Powered False 07:13:16.821207 bus /gobi_0: Setting Powered False 07:13:17.939871 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:13:19.177661 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:19.183567 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:13:19.204924 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:13:19.240259 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:13:19.294441 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:13:19.315263 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:13:19.350432 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:13:19.904749 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:13:19.909824 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:19.920777 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:13:19.980379 tst switch_tch_pdch.py: using LAC 19803 07:13:20.098862 tst switch_tch_pdch.py: using RAC 168 07:13:20.215588 tst switch_tch_pdch.py: using CellId 19803 07:13:20.332156 tst switch_tch_pdch.py: using BVCI 19804 07:13:20.441211 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.452232 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.463065 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.474197 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.485114 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.496084 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.507332 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:13:20.518467 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:13:20.641167 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:13:20.759432 tst switch_tch_pdch.py:51: start network... 07:13:20.962931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:21.408619 run create_hlr_db(pid=6029): Launched 07:13:21.524919 bus /gobi_6: Setting Powered False 07:13:22.585277 run create_hlr_db(pid=6029): Terminated: ok {rc=0} 07:13:22.999978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Launched 07:13:23.325607 run osmo-hlr_10.42.42.2(pid=6032): Launched 07:13:23.451433 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:23.985330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Launched 07:13:24.309950 run osmo-stp_10.42.42.5(pid=6035): Launched 07:13:24.434979 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:24.966062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6037): Launched 07:13:25.089118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:25.363609 run patchelf(pid=6038): Launched 07:13:25.545422 run osmo-stp_10.42.42.5(pid=6035): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] 07:13:25.682261 run osmo-stp_10.42.42.5(pid=6035): stdout: | (launched: 2022-12-09_07:13:24.249763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:25.820008 run osmo-stp_10.42.42.5(pid=6035): stderr: | 20221209071324441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071324441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071324441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071324442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071324442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071324442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071324442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:25.958108 run osmo-stp_10.42.42.5(pid=6035): stdout: | (launched: 2022-12-09_07:13:24.249763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:26.090924 run osmo-stp_10.42.42.5(pid=6035): stderr: | 20221209071324441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071324441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071324441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071324442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071324442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071324442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071324442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:26.249127 run patchelf(pid=6038): Terminating (SIGINT) 07:13:26.428528 run patchelf(pid=6038): Terminated: ok {rc=0} 07:13:26.557617 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6035): Process ended prematurely: osmo-stp_10.42.42.5(pid=6035) [trial-2356↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] [trial-2356↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:13:26.567315 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 07:13:26.595481 run osmo-hlr_10.42.42.2(pid=6032): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6032)] 07:13:26.646185 run osmo-hlr_10.42.42.2(pid=6032): stdout: | (launched: 2022-12-09_07:13:23.265746) 07:13:26.698403 run osmo-hlr_10.42.42.2(pid=6032): stderr: | 20221209071323463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071323463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071323463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071323463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071323463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071323463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071323476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071323485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071323485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071323485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:26.751242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Terminating (SIGTERM) 07:13:26.793707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Terminating (SIGTERM) 07:13:26.836212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6037): Terminating (SIGTERM) 07:13:26.878670 --- ParallelTerminationStrategy: PID 6031 died... 07:13:26.898891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Terminated: ok {rc=0} 07:13:26.945425 --- ParallelTerminationStrategy: PID 6034 died... 07:13:26.965325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Terminated: ok {rc=0} 07:13:27.011776 --- ParallelTerminationStrategy: PID 6037 died... 07:13:27.031466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6037): Terminated: ok {rc=0} 07:13:27.120250 bus /gobi_0: Setting Powered False 07:13:28.220024 bus /gobi_0: Setting Powered False 07:13:29.336768 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:trx-b200 --------------------------------------------------------------------- 07:13:30.575489 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:30.580144 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 07:13:30.614698 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 07:13:30.621579 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 07:13:30.676231 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 07:13:30.711130 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 07:13:30.718427 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 07:13:31.282676 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 07:13:31.290890 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 07:13:31.306963 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 07:13:31.370460 tst mo_mt_sms.py: using LAC 19804 07:13:31.530971 tst mo_mt_sms.py: using RAC 169 07:13:31.658865 tst mo_mt_sms.py: using CellId 19804 07:13:31.783105 tst mo_mt_sms.py: using BVCI 19805 07:13:31.896802 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 07:13:32.036800 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 07:13:32.156229 tst mo_mt_sms.py:9: start nitb and bts... 07:13:32.363645 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:13:32.984187 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6042): Launched 07:13:33.288871 run osmo-nitb_10.42.42.2(pid=6043): Launched 07:13:33.457276 run osmo-nitb_10.42.42.2(pid=6043): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6043)] 07:13:33.593696 run osmo-nitb_10.42.42.2(pid=6043): stdout: | (launched: 2022-12-09_07:13:33.232144) 07:13:33.730972 run osmo-nitb_10.42.42.2(pid=6043): stderr: | (launched: 2022-12-09_07:13:33.277455) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:13:33.868571 run osmo-nitb_10.42.42.2(pid=6043): stdout: | (launched: 2022-12-09_07:13:33.232144) 07:13:34.000908 run osmo-nitb_10.42.42.2(pid=6043): stderr: | (launched: 2022-12-09_07:13:33.277455) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6043) [trial-2356↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6043)] 07:13:34.403734 tst osmo-nitb_10.42.42.2(pid=6043): stdout: | (launched: 2022-12-09_07:13:33.232144) 07:13:34.525891 tst osmo-nitb_10.42.42.2(pid=6043): stderr: | (launched: 2022-12-09_07:13:33.277455) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:13:34.669414 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6043) [trial-2356↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6043)] [trial-2356↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 07:13:34.678096 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:13:34.685069 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6042): Terminating (SIGTERM) 07:13:34.894946 --- ParallelTerminationStrategy: PID 6042 died... 07:13:34.916022 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6042): Terminated: ok {rc=0} 07:13:35.003876 bus /sierra_3: Setting Powered False 07:13:36.106041 bus /sierra_3: Setting Powered False 07:13:37.225310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:trx-b200 --------------------------------------------------------------------- 07:13:38.432669 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:38.437137 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 07:13:38.471614 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:13:38.499384 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 07:13:38.552071 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 07:13:38.586676 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:13:38.614463 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 07:13:39.163711 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 07:13:39.168928 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:39.180368 tst sms:trx-b200: Using 1 x bts (candidates: 1) 07:13:39.231254 tst mo_mt_sms.py: using LAC 19805 07:13:39.359933 tst mo_mt_sms.py: using RAC 170 07:13:39.487131 tst mo_mt_sms.py: using CellId 19805 07:13:39.614213 tst mo_mt_sms.py: using BVCI 19806 07:13:39.733594 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:39.744607 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:39.755649 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:39.767113 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:39.779058 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:39.790602 tst sms:trx-b200: Using 1 x modem (candidates: 2) 07:13:39.911161 tst sms:trx-b200: Using 1 x modem (candidates: 2) 07:13:40.035320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:40.542525 run create_hlr_db(pid=6049): Launched 07:13:40.674776 bus /sierra_2: Setting Powered False 07:13:41.735521 run create_hlr_db(pid=6049): Terminated: ok {rc=0} 07:13:42.169297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6051): Launched 07:13:42.473995 run osmo-hlr_10.42.42.2(pid=6052): Launched 07:13:42.590671 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:43.124878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6054): Launched 07:13:43.429659 run osmo-stp_10.42.42.5(pid=6055): Launched 07:13:43.545565 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:44.095668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6057): Launched 07:13:44.400673 run osmo-msc_10.42.42.6(pid=6058): Launched 07:13:44.571132 run osmo-stp_10.42.42.5(pid=6055): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6055)] 07:13:44.699798 run osmo-stp_10.42.42.5(pid=6055): stdout: | (launched: 2022-12-09_07:13:43.372374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:44.828677 run osmo-stp_10.42.42.5(pid=6055): stderr: | 20221209071343541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071343541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071343541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071343542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071343542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071343542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071343542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:44.955176 run osmo-stp_10.42.42.5(pid=6055): stdout: | (launched: 2022-12-09_07:13:43.372374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:45.075709 run osmo-stp_10.42.42.5(pid=6055): stderr: | 20221209071343541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071343541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071343541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071343542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071343542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071343542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071343542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:45.219882 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6055): Process ended prematurely: osmo-stp_10.42.42.5(pid=6055) [trial-2356↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6055)] [trial-2356↪sms:trx-b200↪mo_mt_sms.py:16] 07:13:45.228369 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 07:13:45.254861 run osmo-hlr_10.42.42.2(pid=6052): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6052)] 07:13:45.303779 run osmo-hlr_10.42.42.2(pid=6052): stdout: | (launched: 2022-12-09_07:13:42.416589) 07:13:45.354162 run osmo-hlr_10.42.42.2(pid=6052): stderr: | 20221209071342594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071342594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071342594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071342594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071342594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071342594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071342607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071342616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071342616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071342616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:45.424110 run osmo-msc_10.42.42.6(pid=6058): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6058)] 07:13:45.472612 run osmo-msc_10.42.42.6(pid=6058): stdout: | (launched: 2022-12-09_07:13:44.343653) 07:13:45.522843 run osmo-msc_10.42.42.6(pid=6058): stderr: | 20221209071344614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071344614 DLGLOBAL DEBUG validating counter group 0x7fd7300ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071344614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071344614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071344614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071344615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071344616 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071344617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071344617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071344617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:45.573548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6051): Terminating (SIGTERM) 07:13:45.614281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6054): Terminating (SIGTERM) 07:13:45.655035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6057): Terminating (SIGTERM) 07:13:45.695740 --- ParallelTerminationStrategy: PID 6051 died... 07:13:45.715068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6051): Terminated: ok {rc=0} 07:13:45.759939 --- ParallelTerminationStrategy: PID 6054 died... 07:13:45.778810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6054): Terminated: ok {rc=0} 07:13:45.823560 --- ParallelTerminationStrategy: PID 6057 died... 07:13:45.853352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6057): Terminated: ok {rc=0} 07:13:45.950574 bus /sierra_3: Setting Powered False 07:13:47.059359 bus /sierra_3: Setting Powered False 07:13:48.186788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-b200 --------------------------------------------------------------------- 07:13:49.421297 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:49.425909 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 07:13:49.462140 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 07:13:49.469282 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 07:13:49.506076 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 07:13:49.541620 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 07:13:49.548713 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 07:13:50.066132 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 07:13:50.071437 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 07:13:50.082495 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 07:13:50.132350 tst assert_extension.py: using LAC 19806 07:13:50.260861 tst assert_extension.py: using RAC 171 07:13:50.387907 tst assert_extension.py: using CellId 19806 07:13:50.516073 tst assert_extension.py: using BVCI 19807 07:13:50.635207 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 07:13:50.751263 tst assert_extension.py:10: start nitb and bts... 07:13:50.954913 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:13:51.576102 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6063): Launched 07:13:51.879865 run osmo-nitb_10.42.42.2(pid=6064): Launched 07:13:52.047971 run osmo-nitb_10.42.42.2(pid=6064): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6064)] 07:13:52.183493 run osmo-nitb_10.42.42.2(pid=6064): stdout: | (launched: 2022-12-09_07:13:51.823175) 07:13:52.320902 run osmo-nitb_10.42.42.2(pid=6064): stderr: | (launched: 2022-12-09_07:13:51.868117) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:13:52.458149 run osmo-nitb_10.42.42.2(pid=6064): stdout: | (launched: 2022-12-09_07:13:51.823175) 07:13:52.590313 run osmo-nitb_10.42.42.2(pid=6064): stderr: | (launched: 2022-12-09_07:13:51.868117) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6064): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6064) [trial-2356↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6064)] 07:13:52.995482 tst osmo-nitb_10.42.42.2(pid=6064): stdout: | (launched: 2022-12-09_07:13:51.823175) 07:13:53.117670 tst osmo-nitb_10.42.42.2(pid=6064): stderr: | (launched: 2022-12-09_07:13:51.868117) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:13:53.261275 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6064): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6064) [trial-2356↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6064)] [trial-2356↪nitb_ussd:trx-b200↪assert_extension.py:12] 07:13:53.269967 tst assert_extension.py:12: Test FAILED (3.2 sec) 07:13:53.276790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6063): Terminating (SIGTERM) 07:13:53.486666 --- ParallelTerminationStrategy: PID 6063 died... 07:13:53.506919 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6063): Terminated: ok {rc=0} 07:13:53.594099 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:trx-b200 --------------------------------------------------------------------- 07:13:54.778325 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:54.782368 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 07:13:54.816835 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:13:54.844274 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 07:13:54.879676 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 07:13:54.914475 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:13:54.942574 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 07:13:55.473216 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:trx-b200 assert_extension.py ---------------------------------------------- 07:13:55.478624 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:55.489995 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 07:13:55.541136 tst assert_extension.py: using LAC 19807 07:13:55.666603 tst assert_extension.py: using RAC 172 07:13:55.792123 tst assert_extension.py: using CellId 19807 07:13:55.917021 tst assert_extension.py: using BVCI 19808 07:13:56.034170 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:56.045315 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:56.056234 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:56.067226 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:56.078268 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:13:56.089314 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 07:13:56.206359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:56.676762 run create_hlr_db(pid=6068): Launched 07:13:56.793354 bus /sierra_2: Setting Powered False 07:13:57.853548 run create_hlr_db(pid=6068): Terminated: ok {rc=0} 07:13:58.297581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6070): Launched 07:13:58.620735 run osmo-hlr_10.42.42.2(pid=6071): Launched 07:13:58.746858 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:59.304154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6073): Launched 07:13:59.627926 run osmo-stp_10.42.42.5(pid=6074): Launched 07:13:59.753684 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:00.338429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6076): Launched 07:14:00.663586 run osmo-msc_10.42.42.6(pid=6077): Launched 07:14:00.862321 run osmo-stp_10.42.42.5(pid=6074): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6074)] 07:14:01.153168 run osmo-stp_10.42.42.5(pid=6074): stdout: | (launched: 2022-12-09_07:13:59.567884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:01.485684 run osmo-stp_10.42.42.5(pid=6074): stderr: | 20221209071359760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071359760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071359760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071359760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071359761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071359761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071359761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:01.619000 run osmo-stp_10.42.42.5(pid=6074): stdout: | (launched: 2022-12-09_07:13:59.567884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:01.744634 run osmo-stp_10.42.42.5(pid=6074): stderr: | 20221209071359760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071359760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071359760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071359760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071359761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071359761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071359761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:01.894188 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6074): Process ended prematurely: osmo-stp_10.42.42.5(pid=6074) [trial-2356↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6074)] [trial-2356↪ussd:trx-b200↪assert_extension.py:17] 07:14:01.903673 tst assert_extension.py:17: Test FAILED (6.4 sec) 07:14:01.935252 run osmo-hlr_10.42.42.2(pid=6071): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6071)] 07:14:01.986729 run osmo-hlr_10.42.42.2(pid=6071): stdout: | (launched: 2022-12-09_07:13:58.560929) 07:14:02.039690 run osmo-hlr_10.42.42.2(pid=6071): stderr: | 20221209071358759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071358759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071358759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071358759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071358759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071358759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071358770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071358779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071358779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071358779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:02.112920 run osmo-msc_10.42.42.6(pid=6077): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6077)] 07:14:02.165747 run osmo-msc_10.42.42.6(pid=6077): stdout: | (launched: 2022-12-09_07:14:00.603134) 07:14:02.218509 run osmo-msc_10.42.42.6(pid=6077): stderr: | 20221209071401043 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071401043 DLGLOBAL DEBUG validating counter group 0x7f223bcc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071401043 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071401043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071401043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071401044 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071401051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071401052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071401052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071401052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:02.271936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6070): Terminating (SIGTERM) 07:14:02.315495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6073): Terminating (SIGTERM) 07:14:02.361997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6076): Terminating (SIGTERM) 07:14:02.407087 --- ParallelTerminationStrategy: PID 6070 died... 07:14:02.427103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6070): Terminated: ok {rc=0} 07:14:02.473434 --- ParallelTerminationStrategy: PID 6073 died... 07:14:02.492357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6073): Terminated: ok {rc=0} 07:14:02.538924 --- ParallelTerminationStrategy: PID 6076 died... 07:14:02.557993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6076): Terminated: ok {rc=0} 07:14:02.647107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:14:03.871194 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:03.878603 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:14:03.913745 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:14:03.941819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:14:03.994034 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:14:04.028722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:14:04.056909 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:14:04.610792 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:14:04.664833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:04.676716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:14:04.747587 tst mo_mt_call.py: using LAC 19808 07:14:04.874541 tst mo_mt_call.py: using RAC 173 07:14:05.002114 tst mo_mt_call.py: using CellId 19808 07:14:05.129545 tst mo_mt_call.py: using BVCI 19809 07:14:05.243355 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:05.254859 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:05.266066 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:05.277693 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:05.289802 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:05.301169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:14:05.420281 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:14:05.537673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:06.016150 run create_hlr_db(pid=6082): Launched 07:14:06.134689 bus /sierra_2: Setting Powered False 07:14:07.195778 run create_hlr_db(pid=6082): Terminated: ok {rc=0} 07:14:07.625543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6084): Launched 07:14:07.934918 run osmo-hlr_10.42.42.2(pid=6085): Launched 07:14:08.052439 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:08.582541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6087): Launched 07:14:08.892535 run osmo-stp_10.42.42.5(pid=6088): Launched 07:14:09.010917 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:09.569647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6090): Launched 07:14:09.878739 run osmo-msc_10.42.42.6(pid=6091): Launched 07:14:10.050900 run osmo-stp_10.42.42.5(pid=6088): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6088)] 07:14:10.181905 run osmo-stp_10.42.42.5(pid=6088): stdout: | (launched: 2022-12-09_07:14:08.835281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:10.311982 run osmo-stp_10.42.42.5(pid=6088): stderr: | 20221209071409005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071409005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071409005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071409006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071409006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071409006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071409006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:10.440458 run osmo-stp_10.42.42.5(pid=6088): stdout: | (launched: 2022-12-09_07:14:08.835281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:10.563657 run osmo-stp_10.42.42.5(pid=6088): stderr: | 20221209071409005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071409005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071409005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071409006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071409006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071409006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071409006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:10.710884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6088): Process ended prematurely: osmo-stp_10.42.42.5(pid=6088) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6088)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:14:10.720025 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:14:10.747060 run osmo-hlr_10.42.42.2(pid=6085): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6085)] 07:14:10.795265 run osmo-hlr_10.42.42.2(pid=6085): stdout: | (launched: 2022-12-09_07:14:07.876444) 07:14:10.845603 run osmo-hlr_10.42.42.2(pid=6085): stderr: | 20221209071408052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071408052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071408052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071408052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071408052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071408052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071408062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071408070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071408070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071408071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:10.915120 run osmo-msc_10.42.42.6(pid=6091): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6091)] 07:14:10.963406 run osmo-msc_10.42.42.6(pid=6091): stdout: | (launched: 2022-12-09_07:14:09.821413) 07:14:11.013301 run osmo-msc_10.42.42.6(pid=6091): stderr: | 20221209071410094 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071410094 DLGLOBAL DEBUG validating counter group 0x7f8cfae3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071410094 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071410094 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071410094 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071410095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071410096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071410097 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071410097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071410097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:11.063299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6084): Terminating (SIGTERM) 07:14:11.103333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6087): Terminating (SIGTERM) 07:14:11.143557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6090): Terminating (SIGTERM) 07:14:11.183927 --- ParallelTerminationStrategy: PID 6084 died... 07:14:11.203032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6084): Terminated: ok {rc=0} 07:14:11.247688 --- ParallelTerminationStrategy: PID 6087 died... 07:14:11.266245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6087): Terminated: ok {rc=0} 07:14:11.311176 --- ParallelTerminationStrategy: PID 6090 died... 07:14:11.330083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6090): Terminated: ok {rc=0} 07:14:11.417203 bus /sierra_3: Setting Powered False 07:14:12.517327 bus /sierra_3: Setting Powered False 07:14:13.634941 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:14:14.783140 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:14.795185 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:14:14.866382 tst mo_mt_call_osmux.py: using LAC 19809 07:14:14.987681 tst mo_mt_call_osmux.py: using RAC 174 07:14:15.108887 tst mo_mt_call_osmux.py: using CellId 19809 07:14:15.229933 tst mo_mt_call_osmux.py: using BVCI 19810 07:14:15.342731 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:15.354001 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:15.365072 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:15.376385 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:15.387721 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:14:15.399041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:14:15.519795 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:14:15.639882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:16.122793 run create_hlr_db(pid=6093): Launched 07:14:16.277212 bus /sierra_2: Setting Powered False 07:14:17.341982 run create_hlr_db(pid=6093): Terminated: ok {rc=0} 07:14:17.782031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6096): Launched 07:14:18.092220 run osmo-hlr_10.42.42.2(pid=6097): Launched 07:14:18.208656 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:18.755435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6099): Launched 07:14:19.066510 run osmo-stp_10.42.42.5(pid=6100): Launched 07:14:19.184466 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:19.742738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6102): Launched 07:14:20.052063 run osmo-msc_10.42.42.6(pid=6103): Launched 07:14:20.223363 run osmo-stp_10.42.42.5(pid=6100): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6100)] 07:14:20.353978 run osmo-stp_10.42.42.5(pid=6100): stdout: | (launched: 2022-12-09_07:14:19.008535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:20.483843 run osmo-stp_10.42.42.5(pid=6100): stderr: | 20221209071419179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071419179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071419179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071419180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071419180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071419180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071419180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:20.611805 run osmo-stp_10.42.42.5(pid=6100): stdout: | (launched: 2022-12-09_07:14:19.008535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:20.735190 run osmo-stp_10.42.42.5(pid=6100): stderr: | 20221209071419179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071419179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071419179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071419180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071419180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071419180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071419180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:20.882376 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6100): Process ended prematurely: osmo-stp_10.42.42.5(pid=6100) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6100)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:14:20.891494 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:14:20.918417 run osmo-hlr_10.42.42.2(pid=6097): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6097)] 07:14:20.967198 run osmo-hlr_10.42.42.2(pid=6097): stdout: | (launched: 2022-12-09_07:14:18.034769) 07:14:21.017621 run osmo-hlr_10.42.42.2(pid=6097): stderr: | 20221209071418211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071418211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071418211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071418211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071418211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071418211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071418224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071418233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071418233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071418233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:21.087720 run osmo-msc_10.42.42.6(pid=6103): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6103)] 07:14:21.136735 run osmo-msc_10.42.42.6(pid=6103): stdout: | (launched: 2022-12-09_07:14:19.994503) 07:14:21.187029 run osmo-msc_10.42.42.6(pid=6103): stderr: | 20221209071420267 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071420267 DLGLOBAL DEBUG validating counter group 0x7feda9589c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071420267 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071420267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071420267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071420267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071420269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071420270 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071420270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071420270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:21.237652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6096): Terminating (SIGTERM) 07:14:21.277885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6099): Terminating (SIGTERM) 07:14:21.318180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6102): Terminating (SIGTERM) 07:14:21.358229 --- ParallelTerminationStrategy: PID 6096 died... 07:14:21.377299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6096): Terminated: ok {rc=0} 07:14:21.422004 --- ParallelTerminationStrategy: PID 6099 died... 07:14:21.440423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6099): Terminated: ok {rc=0} 07:14:21.484904 --- ParallelTerminationStrategy: PID 6102 died... 07:14:21.503949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6102): Terminated: ok {rc=0} 07:14:21.591132 bus /sierra_3: Setting Powered False 07:14:22.691640 bus /sierra_3: Setting Powered False 07:14:23.808629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:14:25.065979 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:25.073258 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:14:25.108551 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:14:25.136529 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:14:25.190777 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:14:25.226125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:14:25.254219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:14:25.805905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:14:25.858548 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:25.870451 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:14:25.946272 tst mo_mt_call.py: using LAC 19810 07:14:26.075555 tst mo_mt_call.py: using RAC 175 07:14:26.204018 tst mo_mt_call.py: using CellId 19810 07:14:26.332889 tst mo_mt_call.py: using BVCI 19811 07:14:26.452363 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:26.464067 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:26.475689 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:26.487151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:26.498749 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:26.510268 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:14:26.627920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:14:26.745694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:27.227596 run create_hlr_db(pid=6108): Launched 07:14:27.346474 bus /sierra_2: Setting Powered False 07:14:28.407435 run create_hlr_db(pid=6108): Terminated: ok {rc=0} 07:14:28.839157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6110): Launched 07:14:29.149731 run osmo-hlr_10.42.42.2(pid=6111): Launched 07:14:29.267358 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:29.812218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6113): Launched 07:14:30.124154 run osmo-stp_10.42.42.5(pid=6114): Launched 07:14:30.242698 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:30.801736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6116): Launched 07:14:31.138247 run osmo-msc_10.42.42.6(pid=6117): Launched 07:14:31.347129 run osmo-stp_10.42.42.5(pid=6114): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6114)] 07:14:31.617476 run osmo-stp_10.42.42.5(pid=6114): stdout: | (launched: 2022-12-09_07:14:30.066307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:31.895509 run osmo-stp_10.42.42.5(pid=6114): stderr: | 20221209071430239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071430239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071430239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071430239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071430240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071430240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071430240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:32.171684 run osmo-stp_10.42.42.5(pid=6114): stdout: | (launched: 2022-12-09_07:14:30.066307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:32.299137 run osmo-stp_10.42.42.5(pid=6114): stderr: | 20221209071430239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071430239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071430239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071430239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071430240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071430240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071430240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:32.448814 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6114): Process ended prematurely: osmo-stp_10.42.42.5(pid=6114) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6114)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:14:32.458287 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:14:32.485498 run osmo-hlr_10.42.42.2(pid=6111): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6111)] 07:14:32.533720 run osmo-hlr_10.42.42.2(pid=6111): stdout: | (launched: 2022-12-09_07:14:29.091508) 07:14:32.583721 run osmo-hlr_10.42.42.2(pid=6111): stderr: | 20221209071429266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071429267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071429267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071429267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071429267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071429267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071429280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071429290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071429290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071429290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:32.653364 run osmo-msc_10.42.42.6(pid=6117): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6117)] 07:14:32.702340 run osmo-msc_10.42.42.6(pid=6117): stdout: | (launched: 2022-12-09_07:14:31.076772) 07:14:32.752337 run osmo-msc_10.42.42.6(pid=6117): stderr: | 20221209071431724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071431724 DLGLOBAL DEBUG validating counter group 0x7f9ac47b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071431724 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071431724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071431729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071431729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071431731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071431731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071431731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071431731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:32.802677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6110): Terminating (SIGTERM) 07:14:32.843331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6113): Terminating (SIGTERM) 07:14:32.883796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6116): Terminating (SIGTERM) 07:14:32.924462 --- ParallelTerminationStrategy: PID 6110 died... 07:14:32.943946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6110): Terminated: ok {rc=0} 07:14:32.988911 --- ParallelTerminationStrategy: PID 6113 died... 07:14:33.008204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6113): Terminated: ok {rc=0} 07:14:33.053672 --- ParallelTerminationStrategy: PID 6116 died... 07:14:33.072853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6116): Terminated: ok {rc=0} 07:14:33.161937 bus /sierra_3: Setting Powered False 07:14:34.263085 bus /sierra_3: Setting Powered False 07:14:35.380911 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:14:36.530936 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:36.543424 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:14:36.614416 tst mo_mt_call_osmux.py: using LAC 19811 07:14:36.735579 tst mo_mt_call_osmux.py: using RAC 176 07:14:36.861788 tst mo_mt_call_osmux.py: using CellId 19811 07:14:36.982635 tst mo_mt_call_osmux.py: using BVCI 19812 07:14:37.095530 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:37.106956 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:37.118310 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:37.129647 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:37.141001 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:14:37.152296 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:14:37.273985 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:14:37.397234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:37.913183 run create_hlr_db(pid=6119): Launched 07:14:38.048777 bus /sierra_2: Setting Powered False 07:14:39.113995 run create_hlr_db(pid=6119): Terminated: ok {rc=0} 07:14:39.557412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6121): Launched 07:14:39.866629 run osmo-hlr_10.42.42.2(pid=6122): Launched 07:14:39.985421 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:40.558957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6124): Launched 07:14:40.890485 run osmo-stp_10.42.42.5(pid=6125): Launched 07:14:41.016799 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:41.619773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6127): Launched 07:14:41.950255 run osmo-msc_10.42.42.6(pid=6128): Launched 07:14:42.133656 run osmo-stp_10.42.42.5(pid=6125): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6125)] 07:14:42.272783 run osmo-stp_10.42.42.5(pid=6125): stdout: | (launched: 2022-12-09_07:14:40.829630) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:42.411754 run osmo-stp_10.42.42.5(pid=6125): stderr: | 20221209071441022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071441022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071441022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071441022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071441023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071441023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071441023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:42.549578 run osmo-stp_10.42.42.5(pid=6125): stdout: | (launched: 2022-12-09_07:14:40.829630) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:42.681207 run osmo-stp_10.42.42.5(pid=6125): stderr: | 20221209071441022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071441022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071441022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071441022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071441023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071441023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071441023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:42.839009 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6125): Process ended prematurely: osmo-stp_10.42.42.5(pid=6125) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6125)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:14:42.848662 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:14:42.876743 run osmo-hlr_10.42.42.2(pid=6122): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6122)] 07:14:42.927365 run osmo-hlr_10.42.42.2(pid=6122): stdout: | (launched: 2022-12-09_07:14:39.808934) 07:14:42.979316 run osmo-hlr_10.42.42.2(pid=6122): stderr: | 20221209071439986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071439986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071439987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071439987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071439987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071439987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071439999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071440007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071440008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071440008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:43.051679 run osmo-msc_10.42.42.6(pid=6128): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6128)] 07:14:43.101966 run osmo-msc_10.42.42.6(pid=6128): stdout: | (launched: 2022-12-09_07:14:41.888827) 07:14:43.154221 run osmo-msc_10.42.42.6(pid=6128): stderr: | 20221209071442211 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071442211 DLGLOBAL DEBUG validating counter group 0x7fa3cf77ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071442211 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071442211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071442212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071442212 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071442214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071442214 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071442214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071442214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:43.206598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6121): Terminating (SIGTERM) 07:14:43.248171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6124): Terminating (SIGTERM) 07:14:43.290111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6127): Terminating (SIGTERM) 07:14:43.332322 --- ParallelTerminationStrategy: PID 6121 died... 07:14:43.352339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6121): Terminated: ok {rc=0} 07:14:43.398725 --- ParallelTerminationStrategy: PID 6124 died... 07:14:43.418432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6124): Terminated: ok {rc=0} 07:14:43.464585 --- ParallelTerminationStrategy: PID 6127 died... 07:14:43.484237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6127): Terminated: ok {rc=0} 07:14:43.572037 bus /sierra_3: Setting Powered False 07:14:44.672019 bus /sierra_3: Setting Powered False 07:14:45.787250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:14:47.060054 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:47.070921 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:14:47.136151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:14:47.171655 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:14:47.226169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:14:47.261833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:14:47.292893 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:14:47.839032 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:14:47.888767 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:47.900287 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:14:47.970071 tst mo_mt_call.py: using LAC 19812 07:14:48.092413 tst mo_mt_call.py: using RAC 177 07:14:48.214657 tst mo_mt_call.py: using CellId 19812 07:14:48.336843 tst mo_mt_call.py: using BVCI 19813 07:14:48.451018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:48.462399 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:48.473485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:48.484624 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:48.495981 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:48.507246 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:14:48.625990 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:14:48.749276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:49.229988 run create_hlr_db(pid=6136): Launched 07:14:49.347043 bus /sierra_2: Setting Powered False 07:14:50.409197 run create_hlr_db(pid=6136): Terminated: ok {rc=0} 07:14:50.840600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6138): Launched 07:14:51.150773 run osmo-hlr_10.42.42.2(pid=6139): Launched 07:14:51.268060 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:51.810954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6141): Launched 07:14:52.120306 run osmo-stp_10.42.42.5(pid=6142): Launched 07:14:52.239640 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:52.798160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6144): Launched 07:14:53.109137 run osmo-msc_10.42.42.6(pid=6145): Launched 07:14:53.281819 run osmo-stp_10.42.42.5(pid=6142): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6142)] 07:14:53.412354 run osmo-stp_10.42.42.5(pid=6142): stdout: | (launched: 2022-12-09_07:14:52.062881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:53.542501 run osmo-stp_10.42.42.5(pid=6142): stderr: | 20221209071452234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071452234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071452235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071452235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071452235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071452235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071452236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:53.670531 run osmo-stp_10.42.42.5(pid=6142): stdout: | (launched: 2022-12-09_07:14:52.062881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:53.793141 run osmo-stp_10.42.42.5(pid=6142): stderr: | 20221209071452234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071452234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071452235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071452235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071452235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071452235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071452236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:53.939844 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6142): Process ended prematurely: osmo-stp_10.42.42.5(pid=6142) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6142)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:14:53.948910 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:14:53.975716 run osmo-hlr_10.42.42.2(pid=6139): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6139)] 07:14:54.024016 run osmo-hlr_10.42.42.2(pid=6139): stdout: | (launched: 2022-12-09_07:14:51.092774) 07:14:54.073607 run osmo-hlr_10.42.42.2(pid=6139): stderr: | 20221209071451269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071451269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071451269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071451269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071451269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071451269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071451280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071451289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071451289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071451289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:54.142808 run osmo-msc_10.42.42.6(pid=6145): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6145)] 07:14:54.191166 run osmo-msc_10.42.42.6(pid=6145): stdout: | (launched: 2022-12-09_07:14:53.051508) 07:14:54.241444 run osmo-msc_10.42.42.6(pid=6145): stderr: | 20221209071453323 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071453323 DLGLOBAL DEBUG validating counter group 0x7f38e9d4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071453323 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071453324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071453324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071453324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071453326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071453326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071453326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071453326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:54.291646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6138): Terminating (SIGTERM) 07:14:54.331682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6141): Terminating (SIGTERM) 07:14:54.371666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6144): Terminating (SIGTERM) 07:14:54.411904 --- ParallelTerminationStrategy: PID 6138 died... 07:14:54.431099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6138): Terminated: ok {rc=0} 07:14:54.475624 --- ParallelTerminationStrategy: PID 6141 died... 07:14:54.494179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6141): Terminated: ok {rc=0} 07:14:54.538993 --- ParallelTerminationStrategy: PID 6144 died... 07:14:54.557896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6144): Terminated: ok {rc=0} 07:14:54.644798 bus /sierra_3: Setting Powered False 07:14:55.745052 bus /sierra_3: Setting Powered False 07:14:56.862037 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:14:58.010395 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:58.022436 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:14:58.097310 tst mo_mt_call_osmux.py: using LAC 19813 07:14:58.217859 tst mo_mt_call_osmux.py: using RAC 178 07:14:58.338934 tst mo_mt_call_osmux.py: using CellId 19813 07:14:58.468368 tst mo_mt_call_osmux.py: using BVCI 19814 07:14:58.589558 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:58.601322 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:58.612818 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:58.624895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:58.637139 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:14:58.649250 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:14:58.769327 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:14:58.888921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:59.369402 run create_hlr_db(pid=6147): Launched 07:14:59.487343 bus /sierra_2: Setting Powered False 07:15:00.548569 run create_hlr_db(pid=6147): Terminated: ok {rc=0} 07:15:00.981132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6149): Launched 07:15:01.307877 run osmo-hlr_10.42.42.2(pid=6150): Launched 07:15:01.464168 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:02.189731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6155): Launched 07:15:02.530663 run osmo-stp_10.42.42.5(pid=6156): Launched 07:15:02.659466 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:03.258806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6158): Launched 07:15:03.588169 run osmo-msc_10.42.42.6(pid=6159): Launched 07:15:03.771379 run osmo-stp_10.42.42.5(pid=6156): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6156)] 07:15:03.910393 run osmo-stp_10.42.42.5(pid=6156): stdout: | (launched: 2022-12-09_07:15:02.469689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:04.048415 run osmo-stp_10.42.42.5(pid=6156): stderr: | 20221209071502660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071502660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071502660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071502661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071502661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071502661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071502661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:04.185907 run osmo-stp_10.42.42.5(pid=6156): stdout: | (launched: 2022-12-09_07:15:02.469689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:04.317557 run osmo-stp_10.42.42.5(pid=6156): stderr: | 20221209071502660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071502660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071502660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071502661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071502661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071502661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071502661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:04.475056 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6156): Process ended prematurely: osmo-stp_10.42.42.5(pid=6156) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6156)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:15:04.484647 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:15:04.512460 run osmo-hlr_10.42.42.2(pid=6150): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6150)] 07:15:04.562455 run osmo-hlr_10.42.42.2(pid=6150): stdout: | (launched: 2022-12-09_07:15:01.247057) 07:15:04.614168 run osmo-hlr_10.42.42.2(pid=6150): stderr: | 20221209071501607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071501607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071501607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071501607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071501608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071501608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071501627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071501643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071501644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071501644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:04.686189 run osmo-msc_10.42.42.6(pid=6159): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6159)] 07:15:04.736186 run osmo-msc_10.42.42.6(pid=6159): stdout: | (launched: 2022-12-09_07:15:03.527601) 07:15:04.787794 run osmo-msc_10.42.42.6(pid=6159): stderr: | 20221209071503849 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071503849 DLGLOBAL DEBUG validating counter group 0x7fd40937cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071503849 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071503850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071503850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071503850 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071503851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071503852 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071503852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071503852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:04.839738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6149): Terminating (SIGTERM) 07:15:04.881645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6155): Terminating (SIGTERM) 07:15:04.923500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6158): Terminating (SIGTERM) 07:15:04.965368 --- ParallelTerminationStrategy: PID 6149 died... 07:15:04.985357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6149): Terminated: ok {rc=0} 07:15:05.031544 --- ParallelTerminationStrategy: PID 6155 died... 07:15:05.050937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6155): Terminated: ok {rc=0} 07:15:05.097081 --- ParallelTerminationStrategy: PID 6158 died... 07:15:05.116544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6158): Terminated: ok {rc=0} 07:15:05.204642 bus /sierra_3: Setting Powered False 07:15:06.303561 bus /sierra_3: Setting Powered False 07:15:07.421406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:15:08.677527 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:08.684535 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:15:08.718965 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:15:08.746696 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:15:08.800335 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:15:08.834979 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:15:08.862728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:15:09.416217 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:15:09.469280 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:09.480833 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:15:09.551700 tst mo_mt_call.py: using LAC 19814 07:15:09.681553 tst mo_mt_call.py: using RAC 179 07:15:09.811000 tst mo_mt_call.py: using CellId 19814 07:15:09.940639 tst mo_mt_call.py: using BVCI 19815 07:15:10.061025 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:10.072748 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:10.084311 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:10.095836 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:10.107566 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:10.119143 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:15:10.238200 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:15:10.360886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:10.874168 run create_hlr_db(pid=6165): Launched 07:15:11.009380 bus /sierra_2: Setting Powered False 07:15:12.074795 run create_hlr_db(pid=6165): Terminated: ok {rc=0} 07:15:12.518512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6167): Launched 07:15:12.829616 run osmo-hlr_10.42.42.2(pid=6168): Launched 07:15:12.946625 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:13.490419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6170): Launched 07:15:13.799059 run osmo-stp_10.42.42.5(pid=6171): Launched 07:15:13.916238 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:14.478984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6173): Launched 07:15:14.788859 run osmo-msc_10.42.42.6(pid=6174): Launched 07:15:14.961473 run osmo-stp_10.42.42.5(pid=6171): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6171)] 07:15:15.091983 run osmo-stp_10.42.42.5(pid=6171): stdout: | (launched: 2022-12-09_07:15:13.741893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:15.222905 run osmo-stp_10.42.42.5(pid=6171): stderr: | 20221209071513910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071513910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071513910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071513911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071513911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071513911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071513912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:15.351445 run osmo-stp_10.42.42.5(pid=6171): stdout: | (launched: 2022-12-09_07:15:13.741893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:15.474756 run osmo-stp_10.42.42.5(pid=6171): stderr: | 20221209071513910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071513910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071513910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071513911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071513911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071513911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071513912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:15.622427 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6171): Process ended prematurely: osmo-stp_10.42.42.5(pid=6171) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6171)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:15:15.631550 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:15:15.658631 run osmo-hlr_10.42.42.2(pid=6168): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6168)] 07:15:15.706932 run osmo-hlr_10.42.42.2(pid=6168): stdout: | (launched: 2022-12-09_07:15:12.771869) 07:15:15.756761 run osmo-hlr_10.42.42.2(pid=6168): stderr: | 20221209071512949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071512949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071512949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071512949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071512949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071512949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071512961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071512972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071512972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071512972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:15.826018 run osmo-msc_10.42.42.6(pid=6174): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6174)] 07:15:15.906177 run osmo-msc_10.42.42.6(pid=6174): stdout: | (launched: 2022-12-09_07:15:14.731309) 07:15:15.961405 run osmo-msc_10.42.42.6(pid=6174): stderr: | 20221209071515003 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071515004 DLGLOBAL DEBUG validating counter group 0x7f4f5771fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071515004 DLSS7[0;m DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071515004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071515004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071515004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071515006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071515006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071515007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071515007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:16.016819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6167): Terminating (SIGTERM) 07:15:16.061804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6170): Terminating (SIGTERM) 07:15:16.106872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6173): Terminating (SIGTERM) 07:15:16.154368 --- ParallelTerminationStrategy: PID 6167 died... 07:15:16.175696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6167): Terminated: ok {rc=0} 07:15:16.226835 --- ParallelTerminationStrategy: PID 6170 died... 07:15:16.247797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6170): Terminated: ok {rc=0} 07:15:16.298276 --- ParallelTerminationStrategy: PID 6173 died... 07:15:16.319780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6173): Terminated: ok {rc=0} 07:15:16.419897 bus /sierra_3: Setting Powered False 07:15:17.529928 bus /sierra_3: Setting Powered False 07:15:18.646728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:15:19.798188 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:19.810646 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:15:19.883912 tst mo_mt_call_osmux.py: using LAC 19815 07:15:20.014674 tst mo_mt_call_osmux.py: using RAC 180 07:15:20.144850 tst mo_mt_call_osmux.py: using CellId 19815 07:15:20.276351 tst mo_mt_call_osmux.py: using BVCI 19816 07:15:20.398469 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:20.410273 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:20.421854 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:20.433373 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:20.444940 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:15:20.456601 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:15:20.574728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:15:20.692573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:21.172032 run create_hlr_db(pid=6177): Launched 07:15:21.290477 bus /sierra_2: Setting Powered False 07:15:22.352148 run create_hlr_db(pid=6177): Terminated: ok {rc=0} 07:15:22.805508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6179): Launched 07:15:23.136440 run osmo-hlr_10.42.42.2(pid=6180): Launched 07:15:23.264006 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:23.833048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6182): Launched 07:15:24.163751 run osmo-stp_10.42.42.5(pid=6183): Launched 07:15:24.291382 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:24.890360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6185): Launched 07:15:25.221373 run osmo-msc_10.42.42.6(pid=6186): Launched 07:15:25.406330 run osmo-stp_10.42.42.5(pid=6183): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6183)] 07:15:25.543900 run osmo-stp_10.42.42.5(pid=6183): stdout: | (launched: 2022-12-09_07:15:24.103142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:25.681998 run osmo-stp_10.42.42.5(pid=6183): stderr: | 20221209071524295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071524295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071524296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071524296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071524297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071524297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071524297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:25.819049 run osmo-stp_10.42.42.5(pid=6183): stdout: | (launched: 2022-12-09_07:15:24.103142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:25.950117 run osmo-stp_10.42.42.5(pid=6183): stderr: | 20221209071524295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071524295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071524296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071524296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071524297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071524297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071524297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:26.107078 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6183): Process ended prematurely: osmo-stp_10.42.42.5(pid=6183) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6183)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:15:26.116811 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:15:26.145165 run osmo-hlr_10.42.42.2(pid=6180): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6180)] 07:15:26.196131 run osmo-hlr_10.42.42.2(pid=6180): stdout: | (launched: 2022-12-09_07:15:23.075699) 07:15:26.248337 run osmo-hlr_10.42.42.2(pid=6180): stderr: | 20221209071523275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071523275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071523275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071523275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071523275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071523275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071523287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071523296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071523296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071523296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:26.321460 run osmo-msc_10.42.42.6(pid=6186): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6186)] 07:15:26.371967 run osmo-msc_10.42.42.6(pid=6186): stdout: | (launched: 2022-12-09_07:15:25.159605) 07:15:26.424488 run osmo-msc_10.42.42.6(pid=6186): stderr: | 20221209071525485 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071525485 DLGLOBAL DEBUG validating counter group 0x7f8826f67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071525485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071525485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071525485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071525486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071525487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071525488 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071525488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071525488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:26.476927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6179): Terminating (SIGTERM) 07:15:26.519098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6182): Terminating (SIGTERM) 07:15:26.561500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6185): Terminating (SIGTERM) 07:15:26.603646 --- ParallelTerminationStrategy: PID 6179 died... 07:15:26.623772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6179): Terminated: ok {rc=0} 07:15:26.670953 --- ParallelTerminationStrategy: PID 6182 died... 07:15:26.690769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6182): Terminated: ok {rc=0} 07:15:26.737217 --- ParallelTerminationStrategy: PID 6185 died... 07:15:26.756829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6185): Terminated: ok {rc=0} 07:15:26.844774 bus /sierra_3: Setting Powered False 07:15:27.943550 bus /sierra_3: Setting Powered False 07:15:29.061131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:15:30.311796 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:30.318765 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:15:30.353314 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:15:30.380126 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:15:30.433089 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:15:30.467046 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:15:30.494270 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:15:31.064756 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:15:31.130020 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:31.143632 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:15:31.220319 tst mo_mt_call.py: using LAC 19816 07:15:31.341614 tst mo_mt_call.py: using RAC 181 07:15:31.497522 tst mo_mt_call.py: using CellId 19816 07:15:31.644108 tst mo_mt_call.py: using BVCI 19817 07:15:31.795306 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:31.808868 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:31.824036 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:31.840049 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:31.857204 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:31.873701 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:15:32.000432 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:15:32.120295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:32.605254 run create_hlr_db(pid=6191): Launched 07:15:32.724492 bus /sierra_2: Setting Powered False 07:15:33.786463 run create_hlr_db(pid=6191): Terminated: ok {rc=0} 07:15:34.216634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6193): Launched 07:15:34.526227 run osmo-hlr_10.42.42.2(pid=6194): Launched 07:15:34.643672 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:35.185496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6196): Launched 07:15:35.493594 run osmo-stp_10.42.42.5(pid=6197): Launched 07:15:35.610560 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:36.167935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6199): Launched 07:15:36.477067 run osmo-msc_10.42.42.6(pid=6200): Launched 07:15:36.650611 run osmo-stp_10.42.42.5(pid=6197): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6197)] 07:15:36.780915 run osmo-stp_10.42.42.5(pid=6197): stdout: | (launched: 2022-12-09_07:15:35.435541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:36.911132 run osmo-stp_10.42.42.5(pid=6197): stderr: | 20221209071535608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071535608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071535608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071535609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071535609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071535609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071535609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:37.039596 run osmo-stp_10.42.42.5(pid=6197): stdout: | (launched: 2022-12-09_07:15:35.435541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:37.162309 run osmo-stp_10.42.42.5(pid=6197): stderr: | 20221209071535608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071535608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071535608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071535609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071535609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071535609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071535609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:37.309575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6197): Process ended prematurely: osmo-stp_10.42.42.5(pid=6197) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6197)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:15:37.318705 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:15:37.345569 run osmo-hlr_10.42.42.2(pid=6194): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6194)] 07:15:37.393681 run osmo-hlr_10.42.42.2(pid=6194): stdout: | (launched: 2022-12-09_07:15:34.467646) 07:15:37.443369 run osmo-hlr_10.42.42.2(pid=6194): stderr: | 20221209071534644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071534644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071534644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071534644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071534644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071534644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071534666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071534675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071534675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071534675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:37.512655 run osmo-msc_10.42.42.6(pid=6200): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6200)] 07:15:37.560752 run osmo-msc_10.42.42.6(pid=6200): stdout: | (launched: 2022-12-09_07:15:36.419634) 07:15:37.610447 run osmo-msc_10.42.42.6(pid=6200): stderr: | 20221209071536690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071536690 DLGLOBAL DEBUG validating counter group 0x7ff68f1dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071536690 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071536691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071536691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071536691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071536693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071536693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071536693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071536693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:37.660543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6193): Terminating (SIGTERM) 07:15:37.700495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6196): Terminating (SIGTERM) 07:15:37.740539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6199): Terminating (SIGTERM) 07:15:37.780811 --- ParallelTerminationStrategy: PID 6193 died... 07:15:37.800041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6193): Terminated: ok {rc=0} 07:15:37.844913 --- ParallelTerminationStrategy: PID 6196 died... 07:15:37.864086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6196): Terminated: ok {rc=0} 07:15:37.908832 --- ParallelTerminationStrategy: PID 6199 died... 07:15:37.928030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6199): Terminated: ok {rc=0} 07:15:38.015715 bus /sierra_3: Setting Powered False 07:15:39.118519 bus /sierra_3: Setting Powered False 07:15:40.238528 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:15:41.392188 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:41.404784 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:15:41.478236 tst mo_mt_call_osmux.py: using LAC 19817 07:15:41.609007 tst mo_mt_call_osmux.py: using RAC 182 07:15:41.745757 tst mo_mt_call_osmux.py: using CellId 19817 07:15:41.866836 tst mo_mt_call_osmux.py: using BVCI 19818 07:15:41.980121 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:41.991639 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:42.003005 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:42.014403 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:42.025796 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:15:42.037326 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:15:42.155340 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:15:42.277232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:42.762071 run create_hlr_db(pid=6202): Launched 07:15:42.879279 bus /sierra_2: Setting Powered False 07:15:43.940429 run create_hlr_db(pid=6202): Terminated: ok {rc=0} 07:15:44.395022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6204): Launched 07:15:44.727680 run osmo-hlr_10.42.42.2(pid=6205): Launched 07:15:44.853709 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:45.425631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6207): Launched 07:15:45.755761 run osmo-stp_10.42.42.5(pid=6208): Launched 07:15:45.951524 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:46.627097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6210): Launched 07:15:46.965645 run osmo-msc_10.42.42.6(pid=6211): Launched 07:15:47.349789 run osmo-stp_10.42.42.5(pid=6208): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6208)] 07:15:47.503614 run osmo-stp_10.42.42.5(pid=6208): stdout: | (launched: 2022-12-09_07:15:45.694780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:47.643376 run osmo-stp_10.42.42.5(pid=6208): stderr: | 20221209071545925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071545925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071545926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071545926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071545927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071545927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071545927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:47.781285 run osmo-stp_10.42.42.5(pid=6208): stdout: | (launched: 2022-12-09_07:15:45.694780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:47.913524 run osmo-stp_10.42.42.5(pid=6208): stderr: | 20221209071545925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071545925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071545926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071545926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071545927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071545927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071545927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:48.071422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6208): Process ended prematurely: osmo-stp_10.42.42.5(pid=6208) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6208)] [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:15:48.081312 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:15:48.109423 run osmo-hlr_10.42.42.2(pid=6205): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6205)] 07:15:48.160315 run osmo-hlr_10.42.42.2(pid=6205): stdout: | (launched: 2022-12-09_07:15:44.666875) 07:15:48.213096 run osmo-hlr_10.42.42.2(pid=6205): stderr: | 20221209071544865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071544866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071544866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071544866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071544866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071544866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071544878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071544887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071544887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071544887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:48.286043 run osmo-msc_10.42.42.6(pid=6211): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6211)] 07:15:48.336880 run osmo-msc_10.42.42.6(pid=6211): stdout: | (launched: 2022-12-09_07:15:46.899475) 07:15:48.389279 run osmo-msc_10.42.42.6(pid=6211): stderr: | 20221209071547304 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071547304 DLGLOBAL DEBUG validating counter group 0x7fcb134b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071547304 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071547304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071547304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071547304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071547306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071547306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071547307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071547307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:48.441949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6204): Terminating (SIGTERM) 07:15:48.484341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6207): Terminating (SIGTERM) 07:15:48.526741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6210): Terminating (SIGTERM) 07:15:48.569421 --- ParallelTerminationStrategy: PID 6204 died... 07:15:48.589884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6204): Terminated: ok {rc=0} 07:15:48.636794 --- ParallelTerminationStrategy: PID 6207 died... 07:15:48.656894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6207): Terminated: ok {rc=0} 07:15:48.703222 --- ParallelTerminationStrategy: PID 6210 died... 07:15:48.722874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6210): Terminated: ok {rc=0} 07:15:48.811172 bus /sierra_3: Setting Powered False 07:15:49.911760 bus /sierra_3: Setting Powered False 07:15:51.029047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:15:52.286917 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:52.294168 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:15:52.329171 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:15:52.357126 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:15:52.412143 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:15:52.447137 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:15:52.474941 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:15:53.031337 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:15:53.083842 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:15:53.095665 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:15:53.171028 tst mo_mt_call.py: using LAC 19818 07:15:53.301642 tst mo_mt_call.py: using RAC 183 07:15:53.423559 tst mo_mt_call.py: using CellId 19818 07:15:53.543806 tst mo_mt_call.py: using BVCI 19819 07:15:53.656399 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:15:53.668037 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:15:53.679455 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:15:53.691051 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:15:53.702818 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:15:53.714504 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:15:53.836805 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:15:53.956067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:54.472135 run create_hlr_db(pid=6216): Launched 07:15:54.607874 bus /sierra_2: Setting Powered False 07:15:55.672506 run create_hlr_db(pid=6216): Terminated: ok {rc=0} 07:15:56.114788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6218): Launched 07:15:56.425387 run osmo-hlr_10.42.42.2(pid=6219): Launched 07:15:56.544669 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:57.088613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6221): Launched 07:15:57.399073 run osmo-stp_10.42.42.5(pid=6222): Launched 07:15:57.519706 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:58.077884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6224): Launched 07:15:58.387738 run osmo-msc_10.42.42.6(pid=6225): Launched 07:15:58.560499 run osmo-stp_10.42.42.5(pid=6222): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6222)] 07:15:58.690709 run osmo-stp_10.42.42.5(pid=6222): stdout: | (launched: 2022-12-09_07:15:57.340715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:58.820287 run osmo-stp_10.42.42.5(pid=6222): stderr: | 20221209071557513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071557513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071557514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071557514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071557515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071557515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071557515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:58.948787 run osmo-stp_10.42.42.5(pid=6222): stdout: | (launched: 2022-12-09_07:15:57.340715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:59.071609 run osmo-stp_10.42.42.5(pid=6222): stderr: | 20221209071557513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071557513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071557514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071557514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071557515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071557515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071557515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:59.218740 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6222): Process ended prematurely: osmo-stp_10.42.42.5(pid=6222) [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6222)] [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:15:59.227748 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:15:59.254736 run osmo-hlr_10.42.42.2(pid=6219): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6219)] 07:15:59.302813 run osmo-hlr_10.42.42.2(pid=6219): stdout: | (launched: 2022-12-09_07:15:56.367694) 07:15:59.352611 run osmo-hlr_10.42.42.2(pid=6219): stderr: | 20221209071556544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071556544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071556544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071556544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071556544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071556544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071556556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071556564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071556564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071556565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:59.421905 run osmo-msc_10.42.42.6(pid=6225): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6225)] 07:15:59.469869 run osmo-msc_10.42.42.6(pid=6225): stdout: | (launched: 2022-12-09_07:15:58.330164) 07:15:59.519529 run osmo-msc_10.42.42.6(pid=6225): stderr: | 20221209071558601 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071558601 DLGLOBAL DEBUG validating counter group 0x7f26fefb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071558601 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071558601 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071558601 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071558602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071558603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071558604 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071558604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071558604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:59.569401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6218): Terminating (SIGTERM) 07:15:59.609199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6221): Terminating (SIGTERM) 07:15:59.649030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6224): Terminating (SIGTERM) 07:15:59.689075 --- ParallelTerminationStrategy: PID 6218 died... 07:15:59.708134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6218): Terminated: ok {rc=0} 07:15:59.752776 --- ParallelTerminationStrategy: PID 6221 died... 07:15:59.771314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6221): Terminated: ok {rc=0} 07:15:59.815383 --- ParallelTerminationStrategy: PID 6224 died... 07:15:59.834032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6224): Terminated: ok {rc=0} 07:15:59.920421 bus /sierra_3: Setting Powered False 07:16:01.033656 bus /sierra_3: Setting Powered False 07:16:02.166331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:16:03.319033 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:16:03.331732 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:16:03.405761 tst mo_mt_call_osmux.py: using LAC 19819 07:16:03.536510 tst mo_mt_call_osmux.py: using RAC 184 07:16:03.667125 tst mo_mt_call_osmux.py: using CellId 19819 07:16:03.796919 tst mo_mt_call_osmux.py: using BVCI 19820 07:16:03.918033 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:16:03.930087 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:16:03.941751 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:16:03.953397 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:16:03.965268 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:16:03.976942 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:16:04.099643 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:16:04.223173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:04.737938 run create_hlr_db(pid=6227): Launched 07:16:04.871831 bus /sierra_2: Setting Powered False 07:16:05.937032 run create_hlr_db(pid=6227): Terminated: ok {rc=0} 07:16:06.378646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6229): Launched 07:16:06.690384 run osmo-hlr_10.42.42.2(pid=6230): Launched 07:16:06.807553 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:07.351253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6232): Launched 07:16:07.661984 run osmo-stp_10.42.42.5(pid=6233): Launched 07:16:07.782999 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:08.339832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6235): Launched 07:16:08.650967 run osmo-msc_10.42.42.6(pid=6236): Launched 07:16:08.828043 run osmo-stp_10.42.42.5(pid=6233): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6233)] 07:16:08.958811 run osmo-stp_10.42.42.5(pid=6233): stdout: | (launched: 2022-12-09_07:16:07.604029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:09.089470 run osmo-stp_10.42.42.5(pid=6233): stderr: | 20221209071607775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071607775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071607775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071607776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071607776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071607776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071607776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:09.218086 run osmo-stp_10.42.42.5(pid=6233): stdout: | (launched: 2022-12-09_07:16:07.604029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:09.341189 run osmo-stp_10.42.42.5(pid=6233): stderr: | 20221209071607775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071607775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071607775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071607776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071607776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071607776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071607776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:09.488721 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6233): Process ended prematurely: osmo-stp_10.42.42.5(pid=6233) [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6233)] [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:16:09.498067 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:16:09.524647 run osmo-hlr_10.42.42.2(pid=6230): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6230)] 07:16:09.573328 run osmo-hlr_10.42.42.2(pid=6230): stdout: | (launched: 2022-12-09_07:16:06.632280) 07:16:09.623427 run osmo-hlr_10.42.42.2(pid=6230): stderr: | 20221209071606811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071606811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071606811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071606811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071606811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071606811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071606822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071606831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071606831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071606831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:09.693439 run osmo-msc_10.42.42.6(pid=6236): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6236)] 07:16:09.741615 run osmo-msc_10.42.42.6(pid=6236): stdout: | (launched: 2022-12-09_07:16:08.593235) 07:16:09.791593 run osmo-msc_10.42.42.6(pid=6236): stderr: | 20221209071608866 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071608866 DLGLOBAL DEBUG validating counter group 0x7f6ca9a4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071608866 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071608866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071608866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071608867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071608868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071608869 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071608869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071608869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:09.842047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6229): Terminating (SIGTERM) 07:16:09.881954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6232): Terminating (SIGTERM) 07:16:09.922147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6235): Terminating (SIGTERM) 07:16:09.962446 --- ParallelTerminationStrategy: PID 6229 died... 07:16:09.981573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6229): Terminated: ok {rc=0} 07:16:10.026308 --- ParallelTerminationStrategy: PID 6232 died... 07:16:10.044758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6232): Terminated: ok {rc=0} 07:16:10.089476 --- ParallelTerminationStrategy: PID 6235 died... 07:16:10.108101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6235): Terminated: ok {rc=0} 07:16:10.194822 bus /sierra_3: Setting Powered False 07:16:11.293884 bus /sierra_3: Setting Powered False 07:16:12.409414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:16:13.665920 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:13.671566 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:16:13.705744 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:16:13.732752 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:16:13.786336 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:16:13.821424 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:16:13.848150 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:16:14.395818 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:16:14.445763 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:14.456897 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:16:14.527705 tst mo_mt_call.py: using LAC 19820 07:16:14.648262 tst mo_mt_call.py: using RAC 185 07:16:14.769761 tst mo_mt_call.py: using CellId 19820 07:16:14.893191 tst mo_mt_call.py: using BVCI 19821 07:16:15.014155 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:15.025905 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:15.037461 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:15.049053 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:15.060650 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:15.072331 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:16:15.190061 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:16:15.307305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:15.784543 run create_hlr_db(pid=6241): Launched 07:16:15.928170 bus /sierra_2: Setting Powered False 07:16:17.007060 run create_hlr_db(pid=6241): Terminated: ok {rc=0} 07:16:17.488842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6243): Launched 07:16:17.821394 run osmo-hlr_10.42.42.2(pid=6244): Launched 07:16:17.947708 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:18.516146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6246): Launched 07:16:18.848521 run osmo-stp_10.42.42.5(pid=6247): Launched 07:16:18.975284 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:19.574747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6249): Launched 07:16:19.906978 run osmo-msc_10.42.42.6(pid=6250): Launched 07:16:20.092598 run osmo-stp_10.42.42.5(pid=6247): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6247)] 07:16:20.231755 run osmo-stp_10.42.42.5(pid=6247): stdout: | (launched: 2022-12-09_07:16:18.787410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:20.371972 run osmo-stp_10.42.42.5(pid=6247): stderr: | 20221209071618979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071618980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071618980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071618980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071618981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071618981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071618981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:20.509491 run osmo-stp_10.42.42.5(pid=6247): stdout: | (launched: 2022-12-09_07:16:18.787410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:20.641486 run osmo-stp_10.42.42.5(pid=6247): stderr: | 20221209071618979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071618980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071618980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071618980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071618981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071618981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071618981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:20.799600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6247): Process ended prematurely: osmo-stp_10.42.42.5(pid=6247) [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6247)] [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:16:20.809503 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:16:20.837801 run osmo-hlr_10.42.42.2(pid=6244): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6244)] 07:16:20.890018 run osmo-hlr_10.42.42.2(pid=6244): stdout: | (launched: 2022-12-09_07:16:17.760273) 07:16:20.942866 run osmo-hlr_10.42.42.2(pid=6244): stderr: | 20221209071617958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071617958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071617958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071617958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071617959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071617959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071617971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071617979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071617980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071617980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:21.016596 run osmo-msc_10.42.42.6(pid=6250): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6250)] 07:16:21.067937 run osmo-msc_10.42.42.6(pid=6250): stdout: | (launched: 2022-12-09_07:16:19.845716) 07:16:21.121216 run osmo-msc_10.42.42.6(pid=6250): stderr: | 20221209071620168 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071620169 DLGLOBAL DEBUG validating counter group 0x7f3d14f44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071620169 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071620169 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071620169 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071620169 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071620171 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071620171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071620171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071620171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:21.174730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6243): Terminating (SIGTERM) 07:16:21.217901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6246): Terminating (SIGTERM) 07:16:21.260901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6249): Terminating (SIGTERM) 07:16:21.303838 --- ParallelTerminationStrategy: PID 6243 died... 07:16:21.324083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6243): Terminated: ok {rc=0} 07:16:21.371105 --- ParallelTerminationStrategy: PID 6246 died... 07:16:21.390823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6246): Terminated: ok {rc=0} 07:16:21.437634 --- ParallelTerminationStrategy: PID 6249 died... 07:16:21.457337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6249): Terminated: ok {rc=0} 07:16:21.544884 bus /sierra_3: Setting Powered False 07:16:22.644784 bus /sierra_3: Setting Powered False 07:16:23.760036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:16:24.910905 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:24.923248 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:16:24.997037 tst mo_mt_call_osmux.py: using LAC 19821 07:16:25.125729 tst mo_mt_call_osmux.py: using RAC 186 07:16:25.255773 tst mo_mt_call_osmux.py: using CellId 19821 07:16:25.386935 tst mo_mt_call_osmux.py: using BVCI 19822 07:16:25.506418 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:25.518074 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:25.529528 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:25.540995 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:25.552376 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:16:25.563872 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:16:25.681894 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:16:25.804415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:26.319426 run create_hlr_db(pid=6252): Launched 07:16:26.453075 bus /sierra_2: Setting Powered False 07:16:27.518949 run create_hlr_db(pid=6252): Terminated: ok {rc=0} 07:16:27.961743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6254): Launched 07:16:28.272317 run osmo-hlr_10.42.42.2(pid=6255): Launched 07:16:28.390374 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:28.937506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6257): Launched 07:16:29.248061 run osmo-stp_10.42.42.5(pid=6258): Launched 07:16:29.366493 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:29.926711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6260): Launched 07:16:30.240391 run osmo-msc_10.42.42.6(pid=6261): Launched 07:16:30.415435 run osmo-stp_10.42.42.5(pid=6258): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6258)] 07:16:30.547183 run osmo-stp_10.42.42.5(pid=6258): stdout: | (launched: 2022-12-09_07:16:29.189786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:30.678944 run osmo-stp_10.42.42.5(pid=6258): stderr: | 20221209071629361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071629361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071629362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071629362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071629362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071629363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071629363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:30.808462 run osmo-stp_10.42.42.5(pid=6258): stdout: | (launched: 2022-12-09_07:16:29.189786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:30.965298 run osmo-stp_10.42.42.5(pid=6258): stderr: | 20221209071629361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071629361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071629362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071629362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071629362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071629363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071629363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:31.129271 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6258): Process ended prematurely: osmo-stp_10.42.42.5(pid=6258) [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6258)] [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:16:31.139515 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:16:31.170505 run osmo-hlr_10.42.42.2(pid=6255): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6255)] 07:16:31.222160 run osmo-hlr_10.42.42.2(pid=6255): stdout: | (launched: 2022-12-09_07:16:28.214922) 07:16:31.275616 run osmo-hlr_10.42.42.2(pid=6255): stderr: | 20221209071628393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071628393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071628393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071628393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071628393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071628393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071628404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071628414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071628415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071628415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:31.349703 run osmo-msc_10.42.42.6(pid=6261): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6261)] 07:16:31.403121 run osmo-msc_10.42.42.6(pid=6261): stdout: | (launched: 2022-12-09_07:16:30.182446) 07:16:31.456925 run osmo-msc_10.42.42.6(pid=6261): stderr: | 20221209071630458 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071630458 DLGLOBAL DEBUG validating counter group 0x7fc32e41ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071630458 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071630458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071630458 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071630458 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071630460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071630460 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071630461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071630461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:31.510704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6254): Terminating (SIGTERM) 07:16:31.554543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6257): Terminating (SIGTERM) 07:16:31.600076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6260): Terminating (SIGTERM) 07:16:31.645209 --- ParallelTerminationStrategy: PID 6254 died... 07:16:31.665508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6254): Terminated: ok {rc=0} 07:16:31.714156 --- ParallelTerminationStrategy: PID 6257 died... 07:16:31.734402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6257): Terminated: ok {rc=0} 07:16:31.782957 --- ParallelTerminationStrategy: PID 6260 died... 07:16:31.803176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6260): Terminated: ok {rc=0} 07:16:31.893913 bus /sierra_3: Setting Powered False 07:16:32.993957 bus /sierra_3: Setting Powered False 07:16:34.110900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 07:16:35.365623 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:35.370674 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 07:16:35.405769 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 07:16:35.433382 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 07:16:35.486593 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 07:16:35.520508 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 07:16:35.547438 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 07:16:36.097439 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 07:16:36.148746 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:36.160258 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 07:16:36.212355 tst mo_mt_call.py: using LAC 19822 07:16:36.337696 tst mo_mt_call.py: using RAC 187 07:16:36.457264 tst mo_mt_call.py: using CellId 19822 07:16:36.577418 tst mo_mt_call.py: using BVCI 19823 07:16:36.690084 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:36.701372 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:36.712237 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:36.723741 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:36.735813 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:36.747562 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:16:36.871701 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:16:36.993940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:37.509572 run create_hlr_db(pid=6266): Launched 07:16:37.645531 bus /sierra_2: Setting Powered False 07:16:38.710349 run create_hlr_db(pid=6266): Terminated: ok {rc=0} 07:16:39.152342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6268): Launched 07:16:39.464249 run osmo-hlr_10.42.42.2(pid=6269): Launched 07:16:39.583109 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:40.130507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6271): Launched 07:16:40.441603 run osmo-stp_10.42.42.5(pid=6272): Launched 07:16:40.560215 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:41.119082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6274): Launched 07:16:41.430889 run osmo-msc_10.42.42.6(pid=6275): Launched 07:16:41.604595 run osmo-stp_10.42.42.5(pid=6272): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6272)] 07:16:41.735450 run osmo-stp_10.42.42.5(pid=6272): stdout: | (launched: 2022-12-09_07:16:40.383993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:41.866104 run osmo-stp_10.42.42.5(pid=6272): stderr: | 20221209071640555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071640555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071640555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071640555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071640556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071640556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071640556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:41.993980 run osmo-stp_10.42.42.5(pid=6272): stdout: | (launched: 2022-12-09_07:16:40.383993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:42.117109 run osmo-stp_10.42.42.5(pid=6272): stderr: | 20221209071640555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071640555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071640555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071640555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071640556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071640556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071640556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:42.264107 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6272): Process ended prematurely: osmo-stp_10.42.42.5(pid=6272) [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6272)] [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 07:16:42.273264 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:16:42.299794 run osmo-hlr_10.42.42.2(pid=6269): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6269)] 07:16:42.347963 run osmo-hlr_10.42.42.2(pid=6269): stdout: | (launched: 2022-12-09_07:16:39.406897) 07:16:42.397508 run osmo-hlr_10.42.42.2(pid=6269): stderr: | 20221209071639584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071639584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071639584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071639584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071639584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071639584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071639597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071639607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071639607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071639607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:42.466670 run osmo-msc_10.42.42.6(pid=6275): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6275)] 07:16:42.514406 run osmo-msc_10.42.42.6(pid=6275): stdout: | (launched: 2022-12-09_07:16:41.372872) 07:16:42.564011 run osmo-msc_10.42.42.6(pid=6275): stderr: | 20221209071641645 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071641645 DLGLOBAL DEBUG validating counter group 0x7f42b0798c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071641645 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071641646 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071641646 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071641646 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071641648 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071641648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071641648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071641648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:42.613728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6268): Terminating (SIGTERM) 07:16:42.653395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6271): Terminating (SIGTERM) 07:16:42.693100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6274): Terminating (SIGTERM) 07:16:42.733471 --- ParallelTerminationStrategy: PID 6268 died... 07:16:42.752486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6268): Terminated: ok {rc=0} 07:16:42.796623 --- ParallelTerminationStrategy: PID 6271 died... 07:16:42.815168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6271): Terminated: ok {rc=0} 07:16:42.859073 --- ParallelTerminationStrategy: PID 6274 died... 07:16:42.877532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6274): Terminated: ok {rc=0} 07:16:42.961075 bus /sierra_3: Setting Powered False 07:16:44.058626 bus /sierra_3: Setting Powered False 07:16:45.175057 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 07:16:46.321603 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:46.334560 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 07:16:46.389646 tst mo_mt_call_osmux.py: using LAC 19823 07:16:46.549525 tst mo_mt_call_osmux.py: using RAC 188 07:16:46.681357 tst mo_mt_call_osmux.py: using CellId 19823 07:16:46.834649 tst mo_mt_call_osmux.py: using BVCI 19824 07:16:46.951850 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:46.964162 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:46.977397 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:46.990376 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:47.003516 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:16:47.015588 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:16:47.140856 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:16:47.275583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:47.756829 run create_hlr_db(pid=6277): Launched 07:16:47.875470 bus /sierra_2: Setting Powered False 07:16:48.937887 run create_hlr_db(pid=6277): Terminated: ok {rc=0} 07:16:49.369921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6279): Launched 07:16:49.679870 run osmo-hlr_10.42.42.2(pid=6280): Launched 07:16:49.797843 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:50.332796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6282): Launched 07:16:50.643075 run osmo-stp_10.42.42.5(pid=6283): Launched 07:16:50.761388 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:51.322813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6285): Launched 07:16:51.633562 run osmo-msc_10.42.42.6(pid=6286): Launched 07:16:51.806679 run osmo-stp_10.42.42.5(pid=6283): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6283)] 07:16:51.937280 run osmo-stp_10.42.42.5(pid=6283): stdout: | (launched: 2022-12-09_07:16:50.584924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:52.067545 run osmo-stp_10.42.42.5(pid=6283): stderr: | 20221209071650755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071650756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071650756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071650756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071650757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071650757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071650757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:52.195832 run osmo-stp_10.42.42.5(pid=6283): stdout: | (launched: 2022-12-09_07:16:50.584924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:52.318673 run osmo-stp_10.42.42.5(pid=6283): stderr: | 20221209071650755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071650756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071650756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071650756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071650757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071650757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071650757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:52.465326 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6283): Process ended prematurely: osmo-stp_10.42.42.5(pid=6283) [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6283)] [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 07:16:52.474396 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:16:52.501200 run osmo-hlr_10.42.42.2(pid=6280): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6280)] 07:16:52.549393 run osmo-hlr_10.42.42.2(pid=6280): stdout: | (launched: 2022-12-09_07:16:49.621900) 07:16:52.599144 run osmo-hlr_10.42.42.2(pid=6280): stderr: | 20221209071649799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071649799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071649800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071649800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071649800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071649800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071649812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071649821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071649821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071649821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:52.668658 run osmo-msc_10.42.42.6(pid=6286): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6286)] 07:16:52.716825 run osmo-msc_10.42.42.6(pid=6286): stdout: | (launched: 2022-12-09_07:16:51.576073) 07:16:52.766555 run osmo-msc_10.42.42.6(pid=6286): stderr: | 20221209071651848 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071651848 DLGLOBAL DEBUG validating counter group 0x7f1c51ecdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071651848 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071651848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071651848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071651849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071651850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071651851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071651851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071651851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:52.816844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6279): Terminating (SIGTERM) 07:16:52.856705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6282): Terminating (SIGTERM) 07:16:52.896502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6285): Terminating (SIGTERM) 07:16:52.936526 --- ParallelTerminationStrategy: PID 6279 died... 07:16:52.955620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6279): Terminated: ok {rc=0} 07:16:52.999868 --- ParallelTerminationStrategy: PID 6282 died... 07:16:53.018370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6282): Terminated: ok {rc=0} 07:16:53.062583 --- ParallelTerminationStrategy: PID 6285 died... 07:16:53.081179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6285): Terminated: ok {rc=0} 07:16:53.168260 bus /sierra_3: Setting Powered False 07:16:54.268417 bus /sierra_3: Setting Powered False 07:16:55.384576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:16:56.634418 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:56.640296 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:16:56.674643 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 07:16:56.701759 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 07:16:56.755641 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:16:56.790533 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 07:16:56.817434 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 07:16:57.369562 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 07:16:57.419637 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:16:57.431160 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:16:57.484292 tst mo_mt_call.py: using LAC 19824 07:16:57.616787 tst mo_mt_call.py: using RAC 189 07:16:57.746402 tst mo_mt_call.py: using CellId 19824 07:16:57.877124 tst mo_mt_call.py: using BVCI 19825 07:16:57.997330 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:16:58.009439 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:16:58.021117 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:16:58.033526 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:16:58.045938 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:16:58.058431 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:16:58.177443 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:16:58.299583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:58.815598 run create_hlr_db(pid=6292): Launched 07:16:58.949095 bus /sierra_2: Setting Powered False 07:17:00.014609 run create_hlr_db(pid=6292): Terminated: ok {rc=0} 07:17:00.477493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6294): Launched 07:17:00.811053 run osmo-hlr_10.42.42.2(pid=6295): Launched 07:17:01.074467 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:01.828094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6300): Launched 07:17:02.170959 run osmo-stp_10.42.42.5(pid=6301): Launched 07:17:02.410719 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:03.021357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6303): Launched 07:17:03.332725 run osmo-msc_10.42.42.6(pid=6304): Launched 07:17:03.505751 run osmo-stp_10.42.42.5(pid=6301): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6301)] 07:17:03.636646 run osmo-stp_10.42.42.5(pid=6301): stdout: | (launched: 2022-12-09_07:17:02.106058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:03.766570 run osmo-stp_10.42.42.5(pid=6301): stderr: | 20221209071702403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071702403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071702403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071702404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071702404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071702404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071702404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:03.895267 run osmo-stp_10.42.42.5(pid=6301): stdout: | (launched: 2022-12-09_07:17:02.106058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:04.018738 run osmo-stp_10.42.42.5(pid=6301): stderr: | 20221209071702403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071702403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071702403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071702404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071702404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071702404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071702404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:04.166254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6301): Process ended prematurely: osmo-stp_10.42.42.5(pid=6301) [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6301)] [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 07:17:04.175387 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 07:17:04.202279 run osmo-hlr_10.42.42.2(pid=6295): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6295)] 07:17:04.251035 run osmo-hlr_10.42.42.2(pid=6295): stdout: | (launched: 2022-12-09_07:17:00.749371) 07:17:04.300879 run osmo-hlr_10.42.42.2(pid=6295): stderr: | 20221209071701048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071701048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071701053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071701053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071701053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071701053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071701067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071701082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071701082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071701082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:04.371002 run osmo-msc_10.42.42.6(pid=6304): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6304)] 07:17:04.418936 run osmo-msc_10.42.42.6(pid=6304): stdout: | (launched: 2022-12-09_07:17:03.274447) 07:17:04.468701 run osmo-msc_10.42.42.6(pid=6304): stderr: | 20221209071703546 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071703546 DLGLOBAL DEBUG validating counter group 0x7fe8b336dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071703546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071703546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071703547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071703547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071703548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071703549 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071703549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071703549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:04.518655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6294): Terminating (SIGTERM) 07:17:04.558818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6300): Terminating (SIGTERM) 07:17:04.598613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6303): Terminating (SIGTERM) 07:17:04.639313 --- ParallelTerminationStrategy: PID 6294 died... 07:17:04.658501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6294): Terminated: ok {rc=0} 07:17:04.703035 --- ParallelTerminationStrategy: PID 6300 died... 07:17:04.721768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6300): Terminated: ok {rc=0} 07:17:04.766386 --- ParallelTerminationStrategy: PID 6303 died... 07:17:04.785083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6303): Terminated: ok {rc=0} 07:17:04.873174 bus /sierra_3: Setting Powered False 07:17:05.973060 bus /sierra_3: Setting Powered False 07:17:07.090036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 07:17:08.238227 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:17:08.250441 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:17:08.304148 tst mo_mt_call_osmux.py: using LAC 19825 07:17:08.424917 tst mo_mt_call_osmux.py: using RAC 190 07:17:08.547038 tst mo_mt_call_osmux.py: using CellId 19825 07:17:08.671250 tst mo_mt_call_osmux.py: using BVCI 19826 07:17:08.782930 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:17:08.794506 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:17:08.805831 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:17:08.817514 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:17:08.829186 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:17:08.840684 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:17:08.961649 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:17:09.085306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:09.566395 run create_hlr_db(pid=6306): Launched 07:17:09.685534 bus /sierra_2: Setting Powered False 07:17:10.746830 run create_hlr_db(pid=6306): Terminated: ok {rc=0} 07:17:11.179237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6308): Launched 07:17:11.492173 run osmo-hlr_10.42.42.2(pid=6309): Launched 07:17:11.610087 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:12.145963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6311): Launched 07:17:12.456116 run osmo-stp_10.42.42.5(pid=6312): Launched 07:17:12.573102 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:13.133013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6314): Launched 07:17:13.445119 run osmo-msc_10.42.42.6(pid=6315): Launched 07:17:13.617613 run osmo-stp_10.42.42.5(pid=6312): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6312)] 07:17:13.752659 run osmo-stp_10.42.42.5(pid=6312): stdout: | (launched: 2022-12-09_07:17:12.397863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:13.883272 run osmo-stp_10.42.42.5(pid=6312): stderr: | 20221209071712570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071712570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071712571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071712571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071712571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071712572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071712572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:14.011566 run osmo-stp_10.42.42.5(pid=6312): stdout: | (launched: 2022-12-09_07:17:12.397863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:14.134465 run osmo-stp_10.42.42.5(pid=6312): stderr: | 20221209071712570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071712570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071712571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071712571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071712571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071712572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071712572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:14.281546 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6312): Process ended prematurely: osmo-stp_10.42.42.5(pid=6312) [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6312)] [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 07:17:14.290490 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:17:14.317158 run osmo-hlr_10.42.42.2(pid=6309): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6309)] 07:17:14.364918 run osmo-hlr_10.42.42.2(pid=6309): stdout: | (launched: 2022-12-09_07:17:11.434436) 07:17:14.414065 run osmo-hlr_10.42.42.2(pid=6309): stderr: | 20221209071711611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071711611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071711611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071711611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071711611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071711611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071711627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071711636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071711636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071711636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:14.483350 run osmo-msc_10.42.42.6(pid=6315): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6315)] 07:17:14.531268 run osmo-msc_10.42.42.6(pid=6315): stdout: | (launched: 2022-12-09_07:17:13.387090) 07:17:14.581280 run osmo-msc_10.42.42.6(pid=6315): stderr: | 20221209071713660 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071713660 DLGLOBAL DEBUG validating counter group 0x7f80882edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071713660 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071713660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071713660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071713660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071713662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071713663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071713663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071713663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:14.631089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6308): Terminating (SIGTERM) 07:17:14.671207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6311): Terminating (SIGTERM) 07:17:14.711195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6314): Terminating (SIGTERM) 07:17:14.751484 --- ParallelTerminationStrategy: PID 6308 died... 07:17:14.770522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6308): Terminated: ok {rc=0} 07:17:14.814689 --- ParallelTerminationStrategy: PID 6311 died... 07:17:14.833350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6311): Terminated: ok {rc=0} 07:17:14.877328 --- ParallelTerminationStrategy: PID 6314 died... 07:17:14.895856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6314): Terminated: ok {rc=0} 07:17:14.981095 bus /sierra_3: Setting Powered False 07:17:16.079861 bus /sierra_3: Setting Powered False 07:17:17.205608 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:trx-b200 --------------------------------------------------------------------- 07:17:18.459935 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:17:18.465714 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 07:17:18.501276 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:17:18.529637 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 07:17:18.617582 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 07:17:18.652375 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:17:18.680365 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 07:17:19.267390 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 07:17:19.273048 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:19.284548 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 07:17:19.337247 tst emergency_mo_mt_call.py: using LAC 19826 07:17:19.473779 tst emergency_mo_mt_call.py: using RAC 191 07:17:19.602417 tst emergency_mo_mt_call.py: using CellId 19826 07:17:19.730332 tst emergency_mo_mt_call.py: using BVCI 19827 07:17:19.849619 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:19.860826 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:19.871953 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:19.883093 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:19.894201 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:19.905281 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:17:20.021984 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:17:20.137538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:20.612471 run create_hlr_db(pid=6320): Launched 07:17:20.730106 bus /sierra_2: Setting Powered False 07:17:21.790451 run create_hlr_db(pid=6320): Terminated: ok {rc=0} 07:17:22.237120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6322): Launched 07:17:22.563459 run osmo-hlr_10.42.42.2(pid=6323): Launched 07:17:22.690093 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:23.251814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6325): Launched 07:17:23.579818 run osmo-stp_10.42.42.5(pid=6326): Launched 07:17:23.715167 tst emergency_mo_mt_call.py: using MSISDN 7086 07:17:23.882280 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:24.468830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6328): Launched 07:17:24.795560 run osmo-msc_10.42.42.6(pid=6329): Launched 07:17:24.976320 run osmo-stp_10.42.42.5(pid=6326): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6326)] 07:17:25.113352 run osmo-stp_10.42.42.5(pid=6326): stdout: | (launched: 2022-12-09_07:17:23.519203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:25.251037 run osmo-stp_10.42.42.5(pid=6326): stderr: | 20221209071723710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071723711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071723711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071723711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071723712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071723712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071723712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:25.387981 run osmo-stp_10.42.42.5(pid=6326): stdout: | (launched: 2022-12-09_07:17:23.519203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:25.517573 run osmo-stp_10.42.42.5(pid=6326): stderr: | 20221209071723710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071723711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071723711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071723711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071723712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071723712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071723712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:25.672359 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6326): Process ended prematurely: osmo-stp_10.42.42.5(pid=6326) [trial-2356↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6326)] [trial-2356↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 07:17:25.681673 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 07:17:25.709315 run osmo-hlr_10.42.42.2(pid=6323): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6323)] 07:17:25.759590 run osmo-hlr_10.42.42.2(pid=6323): stdout: | (launched: 2022-12-09_07:17:22.502740) 07:17:25.811661 run osmo-hlr_10.42.42.2(pid=6323): stderr: | 20221209071722700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071722700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071722700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071722700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071722700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071722700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071722712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071722722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071722722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071722722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:25.884169 run osmo-msc_10.42.42.6(pid=6329): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6329)] 07:17:25.934432 run osmo-msc_10.42.42.6(pid=6329): stdout: | (launched: 2022-12-09_07:17:24.734995) 07:17:25.986100 run osmo-msc_10.42.42.6(pid=6329): stderr: | 20221209071725057 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071725057 DLGLOBAL DEBUG validating counter group 0x7fc436972c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071725057 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071725057 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071725057 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071725057 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071725059 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071725060 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071725060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071725060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:26.038384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6322): Terminating (SIGTERM) 07:17:26.080040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6325): Terminating (SIGTERM) 07:17:26.122109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6328): Terminating (SIGTERM) 07:17:26.164467 --- ParallelTerminationStrategy: PID 6322 died... 07:17:26.184887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6322): Terminated: ok {rc=0} 07:17:26.231779 --- ParallelTerminationStrategy: PID 6325 died... 07:17:26.251901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6325): Terminated: ok {rc=0} 07:17:26.298694 --- ParallelTerminationStrategy: PID 6328 died... 07:17:26.318658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6328): Terminated: ok {rc=0} 07:17:26.407857 bus /sierra_3: Setting Powered False 07:17:27.508279 bus /sierra_3: Setting Powered False 07:17:28.626558 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 07:17:29.714191 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:29.726504 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 07:17:29.781369 tst emergency_preemptive_call.py: using LAC 19827 07:17:29.910107 tst emergency_preemptive_call.py: using RAC 192 07:17:30.038383 tst emergency_preemptive_call.py: using CellId 19827 07:17:30.166300 tst emergency_preemptive_call.py: using BVCI 19828 07:17:30.285508 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:30.296860 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:30.308056 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:30.319279 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:30.331015 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:17:30.342381 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:17:30.459112 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:17:30.576788 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:17:30.698266 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:17:30.817747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:31.368735 run create_hlr_db(pid=6331): Launched 07:17:31.566068 bus /sierra_2: Setting Powered False 07:17:32.626035 run create_hlr_db(pid=6331): Terminated: ok {rc=0} 07:17:33.124862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6333): Launched 07:17:33.432006 run osmo-hlr_10.42.42.2(pid=6334): Launched 07:17:33.549717 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:34.114648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6336): Launched 07:17:34.442143 run osmo-stp_10.42.42.5(pid=6337): Launched 07:17:34.577425 tst emergency_preemptive_call.py: using MSISDN 7087 07:17:34.746132 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:35.334602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6339): Launched 07:17:35.662582 run osmo-msc_10.42.42.6(pid=6340): Launched 07:17:35.849162 run osmo-stp_10.42.42.5(pid=6337): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6337)] 07:17:35.986144 run osmo-stp_10.42.42.5(pid=6337): stdout: | (launched: 2022-12-09_07:17:34.381677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:36.123750 run osmo-stp_10.42.42.5(pid=6337): stderr: | 20221209071734575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071734576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071734576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071734576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071734577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071734577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071734577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:36.261756 run osmo-stp_10.42.42.5(pid=6337): stdout: | (launched: 2022-12-09_07:17:34.381677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:36.391768 run osmo-stp_10.42.42.5(pid=6337): stderr: | 20221209071734575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071734576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071734576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071734576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071734577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071734577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071734577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:36.547022 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6337): Process ended prematurely: osmo-stp_10.42.42.5(pid=6337) [trial-2356↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6337)] [trial-2356↪emergency:trx-b200↪emergency_preemptive_call.py:32] 07:17:36.556298 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 07:17:36.584394 run osmo-hlr_10.42.42.2(pid=6334): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6334)] 07:17:36.635417 run osmo-hlr_10.42.42.2(pid=6334): stdout: | (launched: 2022-12-09_07:17:33.374426) 07:17:36.688196 run osmo-hlr_10.42.42.2(pid=6334): stderr: | 20221209071733550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071733550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071733551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071733551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071733551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071733551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071733564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071733573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071733573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071733573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:36.761708 run osmo-msc_10.42.42.6(pid=6340): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6340)] 07:17:36.812725 run osmo-msc_10.42.42.6(pid=6340): stdout: | (launched: 2022-12-09_07:17:35.601713) 07:17:36.865246 run osmo-msc_10.42.42.6(pid=6340): stderr: | 20221209071735932 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209071735933 DLGLOBAL DEBUG validating counter group 0x7f99902b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209071735933 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209071735933 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209071735933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209071735933 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209071735935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209071735935 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209071735935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209071735935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:36.917711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6333): Terminating (SIGTERM) 07:17:36.959885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6336): Terminating (SIGTERM) 07:17:37.002181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6339): Terminating (SIGTERM) 07:17:37.044499 --- ParallelTerminationStrategy: PID 6333 died... 07:17:37.064919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6333): Terminated: ok {rc=0} 07:17:37.111982 --- ParallelTerminationStrategy: PID 6336 died... 07:17:37.131900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6336): Terminated: ok {rc=0} 07:17:37.178643 --- ParallelTerminationStrategy: PID 6339 died... 07:17:37.198646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6339): Terminated: ok {rc=0} 07:17:37.288214 bus /sierra_9: Setting Powered False 07:17:38.388341 bus /sierra_9: Setting Powered False 07:17:39.507403 bus /sierra_8: Setting Powered False 07:17:40.607555 bus /sierra_8: Setting Powered False 07:17:41.726493 bus /sierra_3: Setting Powered False 07:17:42.827240 bus /sierra_3: Setting Powered False 07:17:43.944785 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-b200 --------------------------------------------------------------------- 07:17:45.228049 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:17:45.232301 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 07:17:45.267824 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 07:17:45.307285 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 07:17:45.395930 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 07:17:45.429759 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 07:17:45.469213 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 07:17:46.080213 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 07:17:46.153511 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.167645 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:17:46.227239 tst cs_paging_gprs_active.py: using LAC 19828 07:17:46.351639 tst cs_paging_gprs_active.py: using RAC 193 07:17:46.513120 tst cs_paging_gprs_active.py: using CellId 19828 07:17:46.662688 tst cs_paging_gprs_active.py: using BVCI 19829 07:17:46.811888 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.823886 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.835681 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.848113 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.860414 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.873319 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.886486 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.899043 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:46.912451 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:17:47.052002 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:17:47.169781 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:17:47.392519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:47.728203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6345): Launched 07:17:48.019757 run iperf3-srv_10.42.42.10(pid=6346): Launched 07:17:48.146073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:17:48.371237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:48.706118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6347): Launched 07:17:48.997011 run iperf3-srv_10.42.42.10(pid=6348): Launched 07:17:49.123202 tst cs_paging_gprs_active.py:38: start network... 07:17:49.347927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:49.866104 run create_hlr_db(pid=6349): Launched 07:17:50.001074 bus /sierra_2: Setting Powered False 07:17:51.065671 run create_hlr_db(pid=6349): Terminated: ok {rc=0} 07:17:51.529361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6351): Launched 07:17:51.863494 run osmo-hlr_10.42.42.2(pid=6352): Launched 07:17:51.989510 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:52.561548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6354): Launched 07:17:52.895451 run osmo-stp_10.42.42.5(pid=6355): Launched 07:17:53.023476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:17:53.599133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6357): Launched 07:17:53.727070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:17:54.008904 run patchelf(pid=6358): Launched 07:17:54.195017 run osmo-stp_10.42.42.5(pid=6355): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6355)] 07:17:54.336135 run osmo-stp_10.42.42.5(pid=6355): stdout: | (launched: 2022-12-09_07:17:52.833997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:54.477871 run osmo-stp_10.42.42.5(pid=6355): stderr: | 20221209071753027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071753027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071753027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071753027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071753028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071753028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071753028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:54.619958 run osmo-stp_10.42.42.5(pid=6355): stdout: | (launched: 2022-12-09_07:17:52.833997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:54.756408 run osmo-stp_10.42.42.5(pid=6355): stderr: | 20221209071753027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071753027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071753027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071753027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071753028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071753028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071753028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:54.918447 run patchelf(pid=6358): Terminating (SIGINT) 07:17:55.103031 run patchelf(pid=6358): Terminated: ok {rc=0} 07:17:55.236438 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6355): Process ended prematurely: osmo-stp_10.42.42.5(pid=6355) [trial-2356↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6355)] [trial-2356↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 07:17:55.247283 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 07:17:55.276273 run osmo-hlr_10.42.42.2(pid=6352): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6352)] 07:17:55.327390 run osmo-hlr_10.42.42.2(pid=6352): stdout: | (launched: 2022-12-09_07:17:51.801899) 07:17:55.379943 run osmo-hlr_10.42.42.2(pid=6352): stderr: | 20221209071752002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071752002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071752002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071752002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071752002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071752002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071752015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071752023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071752023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071752023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:55.433086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6345): Terminating (SIGTERM) 07:17:55.475629 run iperf3-srv_10.42.42.10(pid=6346): Terminating (SIGTERM) 07:17:55.518439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6347): Terminating (SIGTERM) 07:17:55.561169 run iperf3-srv_10.42.42.10(pid=6348): Terminating (SIGTERM) 07:17:55.603736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6351): Terminating (SIGTERM) 07:17:55.646812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6354): Terminating (SIGTERM) 07:17:55.689240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6357): Terminating (SIGTERM) 07:17:55.731967 --- ParallelTerminationStrategy: PID 6345 died... 07:17:55.752148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6345): Terminated: ok {rc=0} 07:17:55.798700 --- ParallelTerminationStrategy: PID 6346 died... 07:17:55.818415 run iperf3-srv_10.42.42.10(pid=6346): Terminated {rc=256} 07:17:55.865208 --- ParallelTerminationStrategy: PID 6347 died... 07:17:55.884798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6347): Terminated: ok {rc=0} 07:17:55.931397 --- ParallelTerminationStrategy: PID 6348 died... 07:17:55.951119 run iperf3-srv_10.42.42.10(pid=6348): Terminated {rc=256} 07:17:55.997250 --- ParallelTerminationStrategy: PID 6351 died... 07:17:56.016860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6351): Terminated: ok {rc=0} 07:17:56.063150 --- ParallelTerminationStrategy: PID 6354 died... 07:17:56.082805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6354): Terminated: ok {rc=0} 07:17:56.129055 --- ParallelTerminationStrategy: PID 6357 died... 07:17:56.148754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6357): Terminated: ok {rc=0} 07:17:56.236598 bus /gobi_0: Setting Powered False 07:17:57.337930 bus /gobi_0: Setting Powered False 07:17:58.458157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200 iperf3.py ---------------------------------------------- 07:17:59.606234 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:59.617851 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:17:59.672162 tst iperf3.py: using LAC 19829 07:17:59.794833 tst iperf3.py: using RAC 194 07:17:59.917392 tst iperf3.py: using CellId 19829 07:18:00.041957 tst iperf3.py: using BVCI 19830 07:18:00.156327 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.167190 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.177906 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.188643 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.199437 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.210537 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.221458 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.231928 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:00.243164 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:00.364730 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:18:00.590915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:00.953429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6359): Launched 07:18:01.246133 run iperf3-srv_10.42.42.10(pid=6360): Launched 07:18:01.383971 tst iperf3.py:8: start network... 07:18:01.603752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:02.107399 run create_hlr_db(pid=6361): Launched 07:18:02.258166 bus /gobi_6: Setting Powered False 07:18:03.319916 run create_hlr_db(pid=6361): Terminated: ok {rc=0} 07:18:03.753488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6363): Launched 07:18:04.063003 run osmo-hlr_10.42.42.2(pid=6364): Launched 07:18:04.180624 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:04.727307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6366): Launched 07:18:05.040250 run osmo-stp_10.42.42.5(pid=6367): Launched 07:18:05.158544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:05.692563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6369): Launched 07:18:05.811169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:06.073654 run patchelf(pid=6370): Launched 07:18:06.246932 run osmo-stp_10.42.42.5(pid=6367): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6367)] 07:18:06.378428 run osmo-stp_10.42.42.5(pid=6367): stdout: | (launched: 2022-12-09_07:18:04.982402) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:06.511269 run osmo-stp_10.42.42.5(pid=6367): stderr: | 20221209071805154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071805154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071805154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071805154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071805155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071805155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071805155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:06.643986 run osmo-stp_10.42.42.5(pid=6367): stdout: | (launched: 2022-12-09_07:18:04.982402) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:06.771388 run osmo-stp_10.42.42.5(pid=6367): stderr: | 20221209071805154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071805154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071805154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071805154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071805155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071805155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071805155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:06.922236 run patchelf(pid=6370): Terminating (SIGINT) 07:18:07.095044 run patchelf(pid=6370): Terminated: ok {rc=0} 07:18:07.219595 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6367): Process ended prematurely: osmo-stp_10.42.42.5(pid=6367) [trial-2356↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6367)] [trial-2356↪gprs:trx-b200↪iperf3.py:8] 07:18:07.229272 tst iperf3.py:8: Test FAILED (7.7 sec) 07:18:07.257044 run osmo-hlr_10.42.42.2(pid=6364): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6364)] 07:18:07.305051 run osmo-hlr_10.42.42.2(pid=6364): stdout: | (launched: 2022-12-09_07:18:04.005456) 07:18:07.354501 run osmo-hlr_10.42.42.2(pid=6364): stderr: | 20221209071804181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071804181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071804181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071804182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071804182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071804182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071804194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071804202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071804202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071804202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:07.404402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6359): Terminating (SIGTERM) 07:18:07.444586 run iperf3-srv_10.42.42.10(pid=6360): Terminating (SIGTERM) 07:18:07.487053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6363): Terminating (SIGTERM) 07:18:07.530806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6366): Terminating (SIGTERM) 07:18:07.573505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6369): Terminating (SIGTERM) 07:18:07.615748 --- ParallelTerminationStrategy: PID 6359 died... 07:18:07.635904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6359): Terminated: ok {rc=0} 07:18:07.683193 --- ParallelTerminationStrategy: PID 6360 died... 07:18:07.703183 run iperf3-srv_10.42.42.10(pid=6360): Terminated {rc=256} 07:18:07.749863 --- ParallelTerminationStrategy: PID 6363 died... 07:18:07.769719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6363): Terminated: ok {rc=0} 07:18:07.816391 --- ParallelTerminationStrategy: PID 6366 died... 07:18:07.836274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6366): Terminated: ok {rc=0} 07:18:07.882932 --- ParallelTerminationStrategy: PID 6369 died... 07:18:07.902733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6369): Terminated: ok {rc=0} 07:18:07.991424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 07:18:09.144033 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.156275 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:18:09.209292 tst iperf3m4.py: using LAC 19830 07:18:09.331812 tst iperf3m4.py: using RAC 195 07:18:09.453882 tst iperf3m4.py: using CellId 19830 07:18:09.585438 tst iperf3m4.py: using BVCI 19831 07:18:09.700739 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.712061 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.722861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.734412 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.745684 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.757068 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.768405 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.779753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:09.791317 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:09.914404 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:10.035615 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:10.158189 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:10.282107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:18:10.508928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:10.843918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6371): Launched 07:18:11.135720 run iperf3-srv_10.42.42.10(pid=6372): Launched 07:18:11.262515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:18:11.487940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:11.823706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6373): Launched 07:18:12.115528 run iperf3-srv_10.42.42.10(pid=6374): Launched 07:18:12.241737 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:18:12.466775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:12.801779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6375): Launched 07:18:13.091293 run iperf3-srv_10.42.42.10(pid=6376): Launched 07:18:13.216311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:18:13.440340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:13.773950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6377): Launched 07:18:14.063941 run iperf3-srv_10.42.42.10(pid=6378): Launched 07:18:14.189650 tst iperf3m4.py:8: start network... 07:18:14.414520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:14.930958 run create_hlr_db(pid=6379): Launched 07:18:15.066743 bus /gobi_6: Setting Powered False 07:18:16.131688 run create_hlr_db(pid=6379): Terminated: ok {rc=0} 07:18:16.588650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6381): Launched 07:18:16.921558 run osmo-hlr_10.42.42.2(pid=6382): Launched 07:18:17.193806 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:17.801641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6384): Launched 07:18:18.134244 run osmo-stp_10.42.42.5(pid=6385): Launched 07:18:18.261731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:18.832411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6387): Launched 07:18:18.962016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:19.243740 run patchelf(pid=6388): Launched 07:18:19.428224 run osmo-stp_10.42.42.5(pid=6385): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6385)] 07:18:19.568155 run osmo-stp_10.42.42.5(pid=6385): stdout: | (launched: 2022-12-09_07:18:18.072761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:19.709307 run osmo-stp_10.42.42.5(pid=6385): stderr: | 20221209071818264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071818264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071818265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071818265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071818266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071818266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071818266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:19.850891 run osmo-stp_10.42.42.5(pid=6385): stdout: | (launched: 2022-12-09_07:18:18.072761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:19.986892 run osmo-stp_10.42.42.5(pid=6385): stderr: | 20221209071818264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071818264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071818265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071818265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071818266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071818266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071818266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:20.147897 run patchelf(pid=6388): Terminating (SIGINT) 07:18:20.333078 run patchelf(pid=6388): Terminated: ok {rc=0} 07:18:20.465988 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6385): Process ended prematurely: osmo-stp_10.42.42.5(pid=6385) [trial-2356↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6385)] [trial-2356↪gprs:trx-b200↪iperf3m4.py:8] 07:18:20.476343 tst iperf3m4.py:8: Test FAILED (11.4 sec) 07:18:20.505341 run osmo-hlr_10.42.42.2(pid=6382): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6382)] 07:18:20.555585 run osmo-hlr_10.42.42.2(pid=6382): stdout: | (launched: 2022-12-09_07:18:16.861288) 07:18:20.607538 run osmo-hlr_10.42.42.2(pid=6382): stderr: | 20221209071817098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071817098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071817098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071817099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071817099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071817099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071817112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071817132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071817132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071817132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:20.659739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6371): Terminating (SIGTERM) 07:18:20.701516 run iperf3-srv_10.42.42.10(pid=6372): Terminating (SIGTERM) 07:18:20.743111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6373): Terminating (SIGTERM) 07:18:20.785013 run iperf3-srv_10.42.42.10(pid=6374): Terminating (SIGTERM) 07:18:20.826879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6375): Terminating (SIGTERM) 07:18:20.868856 run iperf3-srv_10.42.42.10(pid=6376): Terminating (SIGTERM) 07:18:20.910824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6377): Terminating (SIGTERM) 07:18:20.952651 run iperf3-srv_10.42.42.10(pid=6378): Terminating (SIGTERM) 07:18:20.994545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6381): Terminating (SIGTERM) 07:18:21.036519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6384): Terminating (SIGTERM) 07:18:21.078629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6387): Terminating (SIGTERM) 07:18:21.120725 --- ParallelTerminationStrategy: PID 6371 died... 07:18:21.140802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6371): Terminated: ok {rc=0} 07:18:21.187487 --- ParallelTerminationStrategy: PID 6372 died... 07:18:21.207101 run iperf3-srv_10.42.42.10(pid=6372): Terminated {rc=256} 07:18:21.253420 --- ParallelTerminationStrategy: PID 6373 died... 07:18:21.273389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6373): Terminated: ok {rc=0} 07:18:21.320190 --- ParallelTerminationStrategy: PID 6374 died... 07:18:21.340022 run iperf3-srv_10.42.42.10(pid=6374): Terminated {rc=256} 07:18:21.386277 --- ParallelTerminationStrategy: PID 6375 died... 07:18:21.406104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6375): Terminated: ok {rc=0} 07:18:21.452616 --- ParallelTerminationStrategy: PID 6376 died... 07:18:21.472367 run iperf3-srv_10.42.42.10(pid=6376): Terminated {rc=256} 07:18:21.518726 --- ParallelTerminationStrategy: PID 6377 died... 07:18:21.538548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6377): Terminated: ok {rc=0} 07:18:21.584924 --- ParallelTerminationStrategy: PID 6378 died... 07:18:21.604634 run iperf3-srv_10.42.42.10(pid=6378): Terminated {rc=256} 07:18:21.650912 --- ParallelTerminationStrategy: PID 6381 died... 07:18:21.670826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6381): Terminated: ok {rc=0} 07:18:21.717262 --- ParallelTerminationStrategy: PID 6384 died... 07:18:21.736933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6384): Terminated: ok {rc=0} 07:18:21.783725 --- ParallelTerminationStrategy: PID 6387 died... 07:18:21.803963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6387): Terminated: ok {rc=0} 07:18:21.892798 bus /gobi_4: Setting Powered False 07:18:22.993517 bus /gobi_4: Setting Powered False 07:18:24.112031 bus /gobi_1: Setting Powered False 07:18:25.210846 bus /gobi_1: Setting Powered False 07:18:26.323979 bus /gobi_0: Setting Powered False 07:18:27.423640 bus /gobi_0: Setting Powered False 07:18:28.539255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200 ping.py ---------------------------------------------- 07:18:29.641989 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:29.654145 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:18:29.704464 tst ping.py: using LAC 19831 07:18:29.832286 tst ping.py: using RAC 196 07:18:29.958594 tst ping.py: using CellId 19831 07:18:30.085031 tst ping.py: using BVCI 19832 07:18:30.203926 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.215383 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.226575 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.237682 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.248572 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.259548 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.271078 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:30.282291 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:30.399555 tst ping.py:19: start network... 07:18:30.605081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:31.126582 run create_hlr_db(pid=6389): Launched 07:18:31.292163 bus /gobi_6: Setting Powered False 07:18:32.356395 run create_hlr_db(pid=6389): Terminated: ok {rc=0} 07:18:32.795260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6391): Launched 07:18:33.102714 run osmo-hlr_10.42.42.2(pid=6392): Launched 07:18:33.220620 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:33.749790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6394): Launched 07:18:34.082485 run osmo-stp_10.42.42.5(pid=6395): Launched 07:18:34.208007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:34.774062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6397): Launched 07:18:34.899485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:35.175742 run patchelf(pid=6398): Launched 07:18:35.359093 run osmo-stp_10.42.42.5(pid=6395): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6395)] 07:18:35.497152 run osmo-stp_10.42.42.5(pid=6395): stdout: | (launched: 2022-12-09_07:18:34.021522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:35.636365 run osmo-stp_10.42.42.5(pid=6395): stderr: | 20221209071834214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071834214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071834214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071834215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071834215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071834215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071834215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:35.776181 run osmo-stp_10.42.42.5(pid=6395): stdout: | (launched: 2022-12-09_07:18:34.021522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:35.909575 run osmo-stp_10.42.42.5(pid=6395): stderr: | 20221209071834214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071834214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071834214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071834215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071834215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071834215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071834215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:36.068469 run patchelf(pid=6398): Terminating (SIGINT) 07:18:36.249459 run patchelf(pid=6398): Terminated: ok {rc=0} 07:18:36.380265 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6395): Process ended prematurely: osmo-stp_10.42.42.5(pid=6395) [trial-2356↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6395)] [trial-2356↪gprs:trx-b200↪ping.py:22] 07:18:36.390126 tst ping.py:22: Test FAILED (6.7 sec) 07:18:36.418567 run osmo-hlr_10.42.42.2(pid=6392): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6392)] 07:18:36.469576 run osmo-hlr_10.42.42.2(pid=6392): stdout: | (launched: 2022-12-09_07:18:33.045506) 07:18:36.522292 run osmo-hlr_10.42.42.2(pid=6392): stderr: | 20221209071833222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071833222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071833222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071833222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071833222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071833222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071833261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071833272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071833272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071833272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:36.576118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6391): Terminating (SIGTERM) 07:18:36.618936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6394): Terminating (SIGTERM) 07:18:36.661728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6397): Terminating (SIGTERM) 07:18:36.704097 --- ParallelTerminationStrategy: PID 6391 died... 07:18:36.724303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6391): Terminated: ok {rc=0} 07:18:36.771061 --- ParallelTerminationStrategy: PID 6394 died... 07:18:36.791033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6394): Terminated: ok {rc=0} 07:18:36.837551 --- ParallelTerminationStrategy: PID 6397 died... 07:18:36.857236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6397): Terminated: ok {rc=0} 07:18:36.945137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 07:18:38.033593 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.045149 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:18:38.095520 tst ping_idle_ping.py: using LAC 19832 07:18:38.217573 tst ping_idle_ping.py: using RAC 197 07:18:38.349025 tst ping_idle_ping.py: using CellId 19832 07:18:38.478903 tst ping_idle_ping.py: using BVCI 19833 07:18:38.600289 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.611851 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.623251 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.634597 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.645855 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.656827 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.668129 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:18:38.679268 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:18:38.795830 tst ping_idle_ping.py:24: start network... 07:18:39.000106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:39.478138 run create_hlr_db(pid=6399): Launched 07:18:39.612092 bus /gobi_6: Setting Powered False 07:18:40.676906 run create_hlr_db(pid=6399): Terminated: ok {rc=0} 07:18:41.132079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6401): Launched 07:18:41.461665 run osmo-hlr_10.42.42.2(pid=6402): Launched 07:18:41.586928 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:42.148925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6404): Launched 07:18:42.479131 run osmo-stp_10.42.42.5(pid=6405): Launched 07:18:42.603298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:43.168170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6407): Launched 07:18:43.294805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:43.572777 run patchelf(pid=6408): Launched 07:18:43.754736 run osmo-stp_10.42.42.5(pid=6405): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6405)] 07:18:43.892636 run osmo-stp_10.42.42.5(pid=6405): stdout: | (launched: 2022-12-09_07:18:42.417869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:44.032627 run osmo-stp_10.42.42.5(pid=6405): stderr: | 20221209071842612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071842612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071842612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071842613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071842613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071842613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071842613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:44.172042 run osmo-stp_10.42.42.5(pid=6405): stdout: | (launched: 2022-12-09_07:18:42.417869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:44.306811 run osmo-stp_10.42.42.5(pid=6405): stderr: | 20221209071842612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071842612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071842612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071842613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071842613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071842613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071842613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:44.466206 run patchelf(pid=6408): Terminating (SIGINT) 07:18:44.648416 run patchelf(pid=6408): Terminated: ok {rc=0} 07:18:44.779210 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6405): Process ended prematurely: osmo-stp_10.42.42.5(pid=6405) [trial-2356↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6405)] [trial-2356↪gprs:trx-b200↪ping_idle_ping.py:27] 07:18:44.788793 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:18:44.817198 run osmo-hlr_10.42.42.2(pid=6402): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6402)] 07:18:44.867416 run osmo-hlr_10.42.42.2(pid=6402): stdout: | (launched: 2022-12-09_07:18:41.400798) 07:18:44.919373 run osmo-hlr_10.42.42.2(pid=6402): stderr: | 20221209071841602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071841602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071841602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071841602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071841602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071841602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071841624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071841634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071841634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071841634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:44.971702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6401): Terminating (SIGTERM) 07:18:45.013845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6404): Terminating (SIGTERM) 07:18:45.056334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6407): Terminating (SIGTERM) 07:18:45.099173 --- ParallelTerminationStrategy: PID 6401 died... 07:18:45.119604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6401): Terminated: ok {rc=0} 07:18:45.166914 --- ParallelTerminationStrategy: PID 6404 died... 07:18:45.186663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6404): Terminated: ok {rc=0} 07:18:45.233360 --- ParallelTerminationStrategy: PID 6407 died... 07:18:45.252905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6407): Terminated: ok {rc=0} 07:18:45.341718 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 07:18:46.666788 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:18:46.673244 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:18:46.712072 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:18:46.753140 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:18:46.843483 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:18:46.878641 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:18:46.919537 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:18:47.516830 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:18:47.570165 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:47.581602 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:18:47.634324 tst cs_paging_gprs_active.py: using LAC 19833 07:18:47.758420 tst cs_paging_gprs_active.py: using RAC 198 07:18:47.890831 tst cs_paging_gprs_active.py: using CellId 19833 07:18:48.020782 tst cs_paging_gprs_active.py: using BVCI 19834 07:18:48.142052 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.153623 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.164819 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.176235 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.187383 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.198600 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.210090 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.221296 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:48.232642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:18:48.354031 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:18:48.474045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:18:48.684529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:48.998637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6412): Launched 07:18:49.271280 run iperf3-srv_10.42.42.10(pid=6413): Launched 07:18:49.388660 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:18:49.598315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:49.911964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6414): Launched 07:18:50.185094 run iperf3-srv_10.42.42.10(pid=6415): Launched 07:18:50.302431 tst cs_paging_gprs_active.py:38: start network... 07:18:50.511035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:50.992793 run create_hlr_db(pid=6416): Launched 07:18:51.128419 bus /gobi_6: Setting Powered False 07:18:52.194058 run create_hlr_db(pid=6416): Terminated: ok {rc=0} 07:18:52.655982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6418): Launched 07:18:52.990938 run osmo-hlr_10.42.42.2(pid=6419): Launched 07:18:53.119064 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:53.692550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6421): Launched 07:18:54.027075 run osmo-stp_10.42.42.5(pid=6422): Launched 07:18:54.155163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:54.729384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6424): Launched 07:18:54.858621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:55.140436 run patchelf(pid=6425): Launched 07:18:55.325520 run osmo-stp_10.42.42.5(pid=6422): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6422)] 07:18:55.465841 run osmo-stp_10.42.42.5(pid=6422): stdout: | (launched: 2022-12-09_07:18:53.965135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:55.607978 run osmo-stp_10.42.42.5(pid=6422): stderr: | 20221209071854158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071854158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071854158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071854159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071854159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071854159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071854159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:55.748941 run osmo-stp_10.42.42.5(pid=6422): stdout: | (launched: 2022-12-09_07:18:53.965135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:55.884645 run osmo-stp_10.42.42.5(pid=6422): stderr: | 20221209071854158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071854158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071854158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071854159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071854159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071854159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071854159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:56.045981 run patchelf(pid=6425): Terminating (SIGINT) 07:18:56.231020 run patchelf(pid=6425): Terminated: ok {rc=0} 07:18:56.364849 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6422): Process ended prematurely: osmo-stp_10.42.42.5(pid=6422) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6422)] [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:18:56.375235 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:18:56.404006 run osmo-hlr_10.42.42.2(pid=6419): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6419)] 07:18:56.454795 run osmo-hlr_10.42.42.2(pid=6419): stdout: | (launched: 2022-12-09_07:18:52.929088) 07:18:56.506952 run osmo-hlr_10.42.42.2(pid=6419): stderr: | 20221209071853128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071853128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071853128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071853128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071853128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071853128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071853141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071853150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071853150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071853150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:56.559666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6412): Terminating (SIGTERM) 07:18:56.601876 run iperf3-srv_10.42.42.10(pid=6413): Terminating (SIGTERM) 07:18:56.644024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6414): Terminating (SIGTERM) 07:18:56.686357 run iperf3-srv_10.42.42.10(pid=6415): Terminating (SIGTERM) 07:18:56.728437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6418): Terminating (SIGTERM) 07:18:56.770679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6421): Terminating (SIGTERM) 07:18:56.813090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6424): Terminating (SIGTERM) 07:18:56.855355 --- ParallelTerminationStrategy: PID 6412 died... 07:18:56.875498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6412): Terminated: ok {rc=0} 07:18:56.921959 --- ParallelTerminationStrategy: PID 6413 died... 07:18:56.941511 run iperf3-srv_10.42.42.10(pid=6413): Terminated {rc=256} 07:18:56.987728 --- ParallelTerminationStrategy: PID 6414 died... 07:18:57.007352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6414): Terminated: ok {rc=0} 07:18:57.053615 --- ParallelTerminationStrategy: PID 6415 died... 07:18:57.073182 run iperf3-srv_10.42.42.10(pid=6415): Terminated {rc=256} 07:18:57.119466 --- ParallelTerminationStrategy: PID 6418 died... 07:18:57.139108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6418): Terminated: ok {rc=0} 07:18:57.185722 --- ParallelTerminationStrategy: PID 6421 died... 07:18:57.205433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6421): Terminated: ok {rc=0} 07:18:57.251657 --- ParallelTerminationStrategy: PID 6424 died... 07:18:57.271372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6424): Terminated: ok {rc=0} 07:18:57.359011 bus /gobi_0: Setting Powered False 07:18:58.457480 bus /gobi_0: Setting Powered False 07:18:59.574966 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:19:00.726956 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:00.739056 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:19:00.794389 tst iperf3.py: using LAC 19834 07:19:00.945035 tst iperf3.py: using RAC 199 07:19:01.078191 tst iperf3.py: using CellId 19834 07:19:01.206335 tst iperf3.py: using BVCI 19835 07:19:01.329918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.342078 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.354026 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.365857 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.377635 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.389486 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.401599 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.413439 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:01.425447 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:01.546644 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:19:01.775973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:02.114565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6426): Launched 07:19:02.415150 run iperf3-srv_10.42.42.10(pid=6427): Launched 07:19:02.539527 tst iperf3.py:8: start network... 07:19:02.763914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:03.279512 run create_hlr_db(pid=6428): Launched 07:19:03.415375 bus /gobi_6: Setting Powered False 07:19:04.480539 run create_hlr_db(pid=6428): Terminated: ok {rc=0} 07:19:04.924234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6430): Launched 07:19:05.235477 run osmo-hlr_10.42.42.2(pid=6431): Launched 07:19:05.356622 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:05.903507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6433): Launched 07:19:06.215258 run osmo-stp_10.42.42.5(pid=6434): Launched 07:19:06.333612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:06.869117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6436): Launched 07:19:06.989144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:07.252306 run patchelf(pid=6437): Launched 07:19:07.424539 run osmo-stp_10.42.42.5(pid=6434): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6434)] 07:19:07.555997 run osmo-stp_10.42.42.5(pid=6434): stdout: | (launched: 2022-12-09_07:19:06.156890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:07.688559 run osmo-stp_10.42.42.5(pid=6434): stderr: | 20221209071906327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071906327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071906328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071906328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071906329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071906329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071906329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:07.821830 run osmo-stp_10.42.42.5(pid=6434): stdout: | (launched: 2022-12-09_07:19:06.156890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:07.948831 run osmo-stp_10.42.42.5(pid=6434): stderr: | 20221209071906327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071906327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071906328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071906328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071906329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071906329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071906329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:08.099630 run patchelf(pid=6437): Terminating (SIGINT) 07:19:08.273388 run patchelf(pid=6437): Terminated: ok {rc=0} 07:19:08.398233 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6434): Process ended prematurely: osmo-stp_10.42.42.5(pid=6434) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6434)] [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 07:19:08.407918 tst iperf3.py:8: Test FAILED (7.7 sec) 07:19:08.435621 run osmo-hlr_10.42.42.2(pid=6431): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6431)] 07:19:08.484712 run osmo-hlr_10.42.42.2(pid=6431): stdout: | (launched: 2022-12-09_07:19:05.177732) 07:19:08.535267 run osmo-hlr_10.42.42.2(pid=6431): stderr: | 20221209071905352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071905352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071905352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071905352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071905352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071905352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071905366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071905374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071905374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071905374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:08.586324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6426): Terminating (SIGTERM) 07:19:08.626694 run iperf3-srv_10.42.42.10(pid=6427): Terminating (SIGTERM) 07:19:08.666946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6430): Terminating (SIGTERM) 07:19:08.707258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6433): Terminating (SIGTERM) 07:19:08.747631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6436): Terminating (SIGTERM) 07:19:08.788303 --- ParallelTerminationStrategy: PID 6426 died... 07:19:08.807640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6426): Terminated: ok {rc=0} 07:19:08.852654 --- ParallelTerminationStrategy: PID 6427 died... 07:19:08.871546 run iperf3-srv_10.42.42.10(pid=6427): Terminated {rc=256} 07:19:08.916394 --- ParallelTerminationStrategy: PID 6430 died... 07:19:08.935399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6430): Terminated: ok {rc=0} 07:19:08.980204 --- ParallelTerminationStrategy: PID 6433 died... 07:19:08.999165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6433): Terminated: ok {rc=0} 07:19:09.043914 --- ParallelTerminationStrategy: PID 6436 died... 07:19:09.062869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6436): Terminated: ok {rc=0} 07:19:09.150607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:19:10.300049 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.312004 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:19:10.364566 tst iperf3m4.py: using LAC 19835 07:19:10.490716 tst iperf3m4.py: using RAC 200 07:19:10.613363 tst iperf3m4.py: using CellId 19835 07:19:10.743123 tst iperf3m4.py: using BVCI 19836 07:19:10.863866 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.875529 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.887042 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.899006 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.910731 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.922654 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.935024 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.946703 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:10.958689 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:11.078247 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:11.198386 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:11.322746 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:11.440762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:19:11.649856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:11.963687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6438): Launched 07:19:12.234871 run iperf3-srv_10.42.42.10(pid=6439): Launched 07:19:12.353317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:19:12.560363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:12.871287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6440): Launched 07:19:13.141945 run iperf3-srv_10.42.42.10(pid=6441): Launched 07:19:13.259142 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:19:13.466492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:13.777735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6442): Launched 07:19:14.047593 run iperf3-srv_10.42.42.10(pid=6443): Launched 07:19:14.164694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:19:14.372243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:14.683517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6444): Launched 07:19:14.954555 run iperf3-srv_10.42.42.10(pid=6445): Launched 07:19:15.072225 tst iperf3m4.py:8: start network... 07:19:15.279369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:15.758941 run create_hlr_db(pid=6446): Launched 07:19:15.906301 bus /gobi_6: Setting Powered False 07:19:16.989712 run create_hlr_db(pid=6446): Terminated: ok {rc=0} 07:19:17.447363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6448): Launched 07:19:17.758787 run osmo-hlr_10.42.42.2(pid=6449): Launched 07:19:17.878850 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:18.427993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6451): Launched 07:19:18.741085 run osmo-stp_10.42.42.5(pid=6452): Launched 07:19:18.860058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:19.393878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6454): Launched 07:19:19.512361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:19.775899 run patchelf(pid=6455): Launched 07:19:19.949496 run osmo-stp_10.42.42.5(pid=6452): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6452)] 07:19:20.080429 run osmo-stp_10.42.42.5(pid=6452): stdout: | (launched: 2022-12-09_07:19:18.683044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:20.213457 run osmo-stp_10.42.42.5(pid=6452): stderr: | 20221209071918853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071918853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071918854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071918854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071918854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071918855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071918855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:20.347296 run osmo-stp_10.42.42.5(pid=6452): stdout: | (launched: 2022-12-09_07:19:18.683044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:20.474741 run osmo-stp_10.42.42.5(pid=6452): stderr: | 20221209071918853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071918853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071918854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071918854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071918854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071918855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071918855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:20.625653 run patchelf(pid=6455): Terminating (SIGINT) 07:19:20.799152 run patchelf(pid=6455): Terminated: ok {rc=0} 07:19:20.924205 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6452): Process ended prematurely: osmo-stp_10.42.42.5(pid=6452) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6452)] [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 07:19:20.934010 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:19:20.962373 run osmo-hlr_10.42.42.2(pid=6449): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6449)] 07:19:21.011266 run osmo-hlr_10.42.42.2(pid=6449): stdout: | (launched: 2022-12-09_07:19:17.700661) 07:19:21.061639 run osmo-hlr_10.42.42.2(pid=6449): stderr: | 20221209071917874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071917874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071917874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071917874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071917874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071917875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071917892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071917903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071917903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071917903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:21.112407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6438): Terminating (SIGTERM) 07:19:21.152802 run iperf3-srv_10.42.42.10(pid=6439): Terminating (SIGTERM) 07:19:21.193191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6440): Terminating (SIGTERM) 07:19:21.234102 run iperf3-srv_10.42.42.10(pid=6441): Terminating (SIGTERM) 07:19:21.274406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6442): Terminating (SIGTERM) 07:19:21.315991 run iperf3-srv_10.42.42.10(pid=6443): Terminating (SIGTERM) 07:19:21.356308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6444): Terminating (SIGTERM) 07:19:21.396603 run iperf3-srv_10.42.42.10(pid=6445): Terminating (SIGTERM) 07:19:21.436803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6448): Terminating (SIGTERM) 07:19:21.477239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6451): Terminating (SIGTERM) 07:19:21.517589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6454): Terminating (SIGTERM) 07:19:21.558295 --- ParallelTerminationStrategy: PID 6438 died... 07:19:21.577645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6438): Terminated: ok {rc=0} 07:19:21.622616 --- ParallelTerminationStrategy: PID 6439 died... 07:19:21.641315 run iperf3-srv_10.42.42.10(pid=6439): Terminated {rc=256} 07:19:21.685659 --- ParallelTerminationStrategy: PID 6440 died... 07:19:21.704174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6440): Terminated: ok {rc=0} 07:19:21.748716 --- ParallelTerminationStrategy: PID 6441 died... 07:19:21.767444 run iperf3-srv_10.42.42.10(pid=6441): Terminated {rc=256} 07:19:21.811614 --- ParallelTerminationStrategy: PID 6442 died... 07:19:21.830329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6442): Terminated: ok {rc=0} 07:19:21.875028 --- ParallelTerminationStrategy: PID 6443 died... 07:19:21.893575 run iperf3-srv_10.42.42.10(pid=6443): Terminated {rc=256} 07:19:21.937500 --- ParallelTerminationStrategy: PID 6444 died... 07:19:21.956132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6444): Terminated: ok {rc=0} 07:19:22.000376 --- ParallelTerminationStrategy: PID 6445 died... 07:19:22.019033 run iperf3-srv_10.42.42.10(pid=6445): Terminated {rc=256} 07:19:22.062970 --- ParallelTerminationStrategy: PID 6448 died... 07:19:22.081470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6448): Terminated: ok {rc=0} 07:19:22.125745 --- ParallelTerminationStrategy: PID 6451 died... 07:19:22.144406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6451): Terminated: ok {rc=0} 07:19:22.189327 --- ParallelTerminationStrategy: PID 6454 died... 07:19:22.208382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6454): Terminated: ok {rc=0} 07:19:22.295108 bus /gobi_4: Setting Powered False 07:19:23.395884 bus /gobi_4: Setting Powered False 07:19:24.512332 bus /gobi_1: Setting Powered False 07:19:25.612694 bus /gobi_1: Setting Powered False 07:19:26.729100 bus /gobi_0: Setting Powered False 07:19:27.828785 bus /gobi_0: Setting Powered False 07:19:28.945311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 07:19:30.048042 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.059758 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:19:30.111849 tst ping.py: using LAC 19836 07:19:30.233913 tst ping.py: using RAC 201 07:19:30.353100 tst ping.py: using CellId 19836 07:19:30.473081 tst ping.py: using BVCI 19837 07:19:30.583432 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.594618 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.605493 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.616929 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.627852 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.638932 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.650270 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:30.661342 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:30.776835 tst ping.py:19: start network... 07:19:30.995569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:31.477820 run create_hlr_db(pid=6456): Launched 07:19:31.632281 bus /gobi_6: Setting Powered False 07:19:32.693080 run create_hlr_db(pid=6456): Terminated: ok {rc=0} 07:19:33.119698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6458): Launched 07:19:33.428020 run osmo-hlr_10.42.42.2(pid=6459): Launched 07:19:33.545109 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:34.077238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6461): Launched 07:19:34.383266 run osmo-stp_10.42.42.5(pid=6462): Launched 07:19:34.500498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:35.026912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6464): Launched 07:19:35.143784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:35.403674 run patchelf(pid=6465): Launched 07:19:35.574182 run osmo-stp_10.42.42.5(pid=6462): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6462)] 07:19:35.703468 run osmo-stp_10.42.42.5(pid=6462): stdout: | (launched: 2022-12-09_07:19:34.326095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:35.834338 run osmo-stp_10.42.42.5(pid=6462): stderr: | 20221209071934497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071934497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071934497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071934498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071934498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071934498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071934498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:35.964828 run osmo-stp_10.42.42.5(pid=6462): stdout: | (launched: 2022-12-09_07:19:34.326095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:36.090573 run osmo-stp_10.42.42.5(pid=6462): stderr: | 20221209071934497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071934497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071934497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071934498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071934498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071934498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071934498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:36.238958 run patchelf(pid=6465): Terminating (SIGINT) 07:19:36.409576 run patchelf(pid=6465): Terminated: ok {rc=0} 07:19:36.532100 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6462): Process ended prematurely: osmo-stp_10.42.42.5(pid=6462) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6462)] [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 07:19:36.541279 tst ping.py:22: Test FAILED (6.5 sec) 07:19:36.568819 run osmo-hlr_10.42.42.2(pid=6459): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6459)] 07:19:36.617452 run osmo-hlr_10.42.42.2(pid=6459): stdout: | (launched: 2022-12-09_07:19:33.370181) 07:19:36.667133 run osmo-hlr_10.42.42.2(pid=6459): stderr: | 20221209071933545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071933546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071933546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071933546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071933546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071933546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071933558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071933569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071933569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071933569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:36.717577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6458): Terminating (SIGTERM) 07:19:36.758006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6461): Terminating (SIGTERM) 07:19:36.798209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6464): Terminating (SIGTERM) 07:19:36.838981 --- ParallelTerminationStrategy: PID 6458 died... 07:19:36.858267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6458): Terminated: ok {rc=0} 07:19:36.903514 --- ParallelTerminationStrategy: PID 6461 died... 07:19:36.922347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6461): Terminated: ok {rc=0} 07:19:36.967665 --- ParallelTerminationStrategy: PID 6464 died... 07:19:36.986785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6464): Terminated: ok {rc=0} 07:19:37.071846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:19:38.160450 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.173498 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:19:38.229940 tst ping_idle_ping.py: using LAC 19837 07:19:38.360619 tst ping_idle_ping.py: using RAC 202 07:19:38.489434 tst ping_idle_ping.py: using CellId 19837 07:19:38.611928 tst ping_idle_ping.py: using BVCI 19838 07:19:38.724498 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.735840 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.746898 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.758279 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.769451 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.780759 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.791955 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:19:38.803060 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:19:38.920689 tst ping_idle_ping.py:24: start network... 07:19:39.126372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:39.606155 run create_hlr_db(pid=6466): Launched 07:19:39.725539 bus /gobi_6: Setting Powered False 07:19:40.786494 run create_hlr_db(pid=6466): Terminated: ok {rc=0} 07:19:41.236613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6468): Launched 07:19:41.568338 run osmo-hlr_10.42.42.2(pid=6469): Launched 07:19:41.695359 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:42.264887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6471): Launched 07:19:42.595697 run osmo-stp_10.42.42.5(pid=6472): Launched 07:19:42.721909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:43.290935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6474): Launched 07:19:43.416147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:43.694189 run patchelf(pid=6475): Launched 07:19:43.875642 run osmo-stp_10.42.42.5(pid=6472): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6472)] 07:19:44.014132 run osmo-stp_10.42.42.5(pid=6472): stdout: | (launched: 2022-12-09_07:19:42.534120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:44.154005 run osmo-stp_10.42.42.5(pid=6472): stderr: | 20221209071942727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071942727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071942727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071942727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071942728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071942728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071942728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:44.294075 run osmo-stp_10.42.42.5(pid=6472): stdout: | (launched: 2022-12-09_07:19:42.534120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:44.429347 run osmo-stp_10.42.42.5(pid=6472): stderr: | 20221209071942727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071942727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071942727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071942727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071942728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071942728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071942728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:44.589101 run patchelf(pid=6475): Terminating (SIGINT) 07:19:44.771513 run patchelf(pid=6475): Terminated: ok {rc=0} 07:19:44.903122 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6472): Process ended prematurely: osmo-stp_10.42.42.5(pid=6472) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6472)] [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 07:19:44.912917 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:19:44.941538 run osmo-hlr_10.42.42.2(pid=6469): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6469)] 07:19:44.992561 run osmo-hlr_10.42.42.2(pid=6469): stdout: | (launched: 2022-12-09_07:19:41.507237) 07:19:45.045384 run osmo-hlr_10.42.42.2(pid=6469): stderr: | 20221209071941704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071941704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071941704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071941704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071941704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071941704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071941717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071941727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071941727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071941728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:45.098321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6468): Terminating (SIGTERM) 07:19:45.140798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6471): Terminating (SIGTERM) 07:19:45.183349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6474): Terminating (SIGTERM) 07:19:45.226163 --- ParallelTerminationStrategy: PID 6468 died... 07:19:45.246256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6468): Terminated: ok {rc=0} 07:19:45.293221 --- ParallelTerminationStrategy: PID 6471 died... 07:19:45.313603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6471): Terminated: ok {rc=0} 07:19:45.360455 --- ParallelTerminationStrategy: PID 6474 died... 07:19:45.380358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6474): Terminated: ok {rc=0} 07:19:45.469353 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:19:46.786663 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:19:46.792630 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:19:46.831279 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:19:46.873061 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:19:46.960894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:19:46.997360 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:19:47.039487 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:19:47.636855 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:19:47.690244 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:47.701793 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:19:47.772356 tst cs_paging_gprs_active.py: using LAC 19838 07:19:47.900785 tst cs_paging_gprs_active.py: using RAC 203 07:19:48.028803 tst cs_paging_gprs_active.py: using CellId 19838 07:19:48.157419 tst cs_paging_gprs_active.py: using BVCI 19839 07:19:48.279906 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.291325 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.303002 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.314424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.325707 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.336928 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.348371 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.359800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:48.371188 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:19:48.495489 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:19:48.618595 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:19:48.829525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:49.142196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6479): Launched 07:19:49.415539 run iperf3-srv_10.42.42.10(pid=6480): Launched 07:19:49.532788 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:19:49.741131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:50.053378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6481): Launched 07:19:50.322894 run iperf3-srv_10.42.42.10(pid=6482): Launched 07:19:50.439428 tst cs_paging_gprs_active.py:38: start network... 07:19:50.647173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:51.129113 run create_hlr_db(pid=6483): Launched 07:19:51.248269 bus /gobi_6: Setting Powered False 07:19:52.310183 run create_hlr_db(pid=6483): Terminated: ok {rc=0} 07:19:52.742993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6485): Launched 07:19:53.054587 run osmo-hlr_10.42.42.2(pid=6486): Launched 07:19:53.172523 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:53.719394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6488): Launched 07:19:54.032138 run osmo-stp_10.42.42.5(pid=6489): Launched 07:19:54.150008 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:54.686192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6491): Launched 07:19:54.805851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:55.069286 run patchelf(pid=6492): Launched 07:19:55.241525 run osmo-stp_10.42.42.5(pid=6489): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6489)] 07:19:55.372748 run osmo-stp_10.42.42.5(pid=6489): stdout: | (launched: 2022-12-09_07:19:53.974549) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:55.505170 run osmo-stp_10.42.42.5(pid=6489): stderr: | 20221209071954146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071954146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071954146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071954147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071954147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071954147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071954147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:55.637622 run osmo-stp_10.42.42.5(pid=6489): stdout: | (launched: 2022-12-09_07:19:53.974549) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:55.764916 run osmo-stp_10.42.42.5(pid=6489): stderr: | 20221209071954146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209071954146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209071954146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209071954147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209071954147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209071954147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209071954147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:55.915993 run patchelf(pid=6492): Terminating (SIGINT) 07:19:56.089262 run patchelf(pid=6492): Terminated: ok {rc=0} 07:19:56.213985 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6489): Process ended prematurely: osmo-stp_10.42.42.5(pid=6489) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6489)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:19:56.223663 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:19:56.251317 run osmo-hlr_10.42.42.2(pid=6486): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6486)] 07:19:56.299301 run osmo-hlr_10.42.42.2(pid=6486): stdout: | (launched: 2022-12-09_07:19:52.996056) 07:19:56.349304 run osmo-hlr_10.42.42.2(pid=6486): stderr: | 20221209071953172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209071953172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209071953172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209071953172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209071953172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209071953172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209071953184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209071953192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209071953192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209071953192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:56.399532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6479): Terminating (SIGTERM) 07:19:56.439544 run iperf3-srv_10.42.42.10(pid=6480): Terminating (SIGTERM) 07:19:56.479463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6481): Terminating (SIGTERM) 07:19:56.519344 run iperf3-srv_10.42.42.10(pid=6482): Terminating (SIGTERM) 07:19:56.559206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6485): Terminating (SIGTERM) 07:19:56.599123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6488): Terminating (SIGTERM) 07:19:56.638982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6491): Terminating (SIGTERM) 07:19:56.679042 --- ParallelTerminationStrategy: PID 6479 died... 07:19:56.698074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6479): Terminated: ok {rc=0} 07:19:56.742504 --- ParallelTerminationStrategy: PID 6480 died... 07:19:56.761003 run iperf3-srv_10.42.42.10(pid=6480): Terminated {rc=256} 07:19:56.805181 --- ParallelTerminationStrategy: PID 6481 died... 07:19:56.823748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6481): Terminated: ok {rc=0} 07:19:56.867898 --- ParallelTerminationStrategy: PID 6482 died... 07:19:56.886383 run iperf3-srv_10.42.42.10(pid=6482): Terminated {rc=256} 07:19:56.931014 --- ParallelTerminationStrategy: PID 6485 died... 07:19:56.949538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6485): Terminated: ok {rc=0} 07:19:56.993827 --- ParallelTerminationStrategy: PID 6488 died... 07:19:57.012496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6488): Terminated: ok {rc=0} 07:19:57.056622 --- ParallelTerminationStrategy: PID 6491 died... 07:19:57.075336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6491): Terminated: ok {rc=0} 07:19:57.159410 bus /gobi_0: Setting Powered False 07:19:58.259213 bus /gobi_0: Setting Powered False 07:19:59.377309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:20:00.528481 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:00.540998 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:20:00.620619 tst iperf3.py: using LAC 19839 07:20:00.749190 tst iperf3.py: using RAC 204 07:20:00.885160 tst iperf3.py: using CellId 19839 07:20:01.023508 tst iperf3.py: using BVCI 19840 07:20:01.179285 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.194441 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.210534 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.226356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.241389 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.256636 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.272182 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.287541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:01.302618 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:01.429083 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:20:01.643237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:01.964244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6497): Launched 07:20:02.251750 run iperf3-srv_10.42.42.10(pid=6498): Launched 07:20:02.384637 tst iperf3.py:8: start network... 07:20:02.593143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:03.075504 run create_hlr_db(pid=6499): Launched 07:20:03.194141 bus /gobi_6: Setting Powered False 07:20:04.255285 run create_hlr_db(pid=6499): Terminated: ok {rc=0} 07:20:04.688559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6501): Launched 07:20:05.000064 run osmo-hlr_10.42.42.2(pid=6502): Launched 07:20:05.117699 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:05.651177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6504): Launched 07:20:05.963543 run osmo-stp_10.42.42.5(pid=6505): Launched 07:20:06.082882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:06.618115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6507): Launched 07:20:06.738934 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:07.002292 run patchelf(pid=6508): Launched 07:20:07.175952 run osmo-stp_10.42.42.5(pid=6505): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6505)] 07:20:07.308003 run osmo-stp_10.42.42.5(pid=6505): stdout: | (launched: 2022-12-09_07:20:05.905682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:07.441115 run osmo-stp_10.42.42.5(pid=6505): stderr: | 20221209072006076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072006077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072006077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072006077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072006078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072006078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072006078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:07.574224 run osmo-stp_10.42.42.5(pid=6505): stdout: | (launched: 2022-12-09_07:20:05.905682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:07.701786 run osmo-stp_10.42.42.5(pid=6505): stderr: | 20221209072006076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072006077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072006077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072006077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072006078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072006078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072006078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:07.852421 run patchelf(pid=6508): Terminating (SIGINT) 07:20:08.025837 run patchelf(pid=6508): Terminated: ok {rc=0} 07:20:08.150904 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6505): Process ended prematurely: osmo-stp_10.42.42.5(pid=6505) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6505)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 07:20:08.160544 tst iperf3.py:8: Test FAILED (7.7 sec) 07:20:08.188859 run osmo-hlr_10.42.42.2(pid=6502): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6502)] 07:20:08.237848 run osmo-hlr_10.42.42.2(pid=6502): stdout: | (launched: 2022-12-09_07:20:04.942223) 07:20:08.288551 run osmo-hlr_10.42.42.2(pid=6502): stderr: | 20221209072005118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072005118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072005118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072005118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072005118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072005118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072005131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072005142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072005142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072005142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:08.339956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6497): Terminating (SIGTERM) 07:20:08.380873 run iperf3-srv_10.42.42.10(pid=6498): Terminating (SIGTERM) 07:20:08.421698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6501): Terminating (SIGTERM) 07:20:08.462617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6504): Terminating (SIGTERM) 07:20:08.503307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6507): Terminating (SIGTERM) 07:20:08.544202 --- ParallelTerminationStrategy: PID 6497 died... 07:20:08.563827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6497): Terminated: ok {rc=0} 07:20:08.609683 --- ParallelTerminationStrategy: PID 6498 died... 07:20:08.628589 run iperf3-srv_10.42.42.10(pid=6498): Terminated {rc=256} 07:20:08.674113 --- ParallelTerminationStrategy: PID 6501 died... 07:20:08.693187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6501): Terminated: ok {rc=0} 07:20:08.738383 --- ParallelTerminationStrategy: PID 6504 died... 07:20:08.757365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6504): Terminated: ok {rc=0} 07:20:08.802737 --- ParallelTerminationStrategy: PID 6507 died... 07:20:08.821811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6507): Terminated: ok {rc=0} 07:20:08.907831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:20:10.059734 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.072185 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:20:10.145822 tst iperf3m4.py: using LAC 19840 07:20:10.277836 tst iperf3m4.py: using RAC 205 07:20:10.410661 tst iperf3m4.py: using CellId 19840 07:20:10.541448 tst iperf3m4.py: using BVCI 19841 07:20:10.655468 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.667004 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.678409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.689914 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.701075 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.712637 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.723954 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.735025 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:10.746217 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:10.864138 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:10.989306 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:11.106697 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:11.227586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:20:11.437210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:11.750616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6509): Launched 07:20:12.024193 run iperf3-srv_10.42.42.10(pid=6510): Launched 07:20:12.141259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:20:12.349284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:12.662219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6511): Launched 07:20:12.933644 run iperf3-srv_10.42.42.10(pid=6512): Launched 07:20:13.049613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:20:13.256936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:13.568866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6513): Launched 07:20:13.840154 run iperf3-srv_10.42.42.10(pid=6514): Launched 07:20:13.958792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:20:14.166189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:14.479289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6515): Launched 07:20:14.752549 run iperf3-srv_10.42.42.10(pid=6516): Launched 07:20:14.871222 tst iperf3m4.py:8: start network... 07:20:15.079547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:15.562945 run create_hlr_db(pid=6517): Launched 07:20:15.683925 bus /gobi_6: Setting Powered False 07:20:16.750468 run create_hlr_db(pid=6517): Terminated: ok {rc=0} 07:20:17.223556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6519): Launched 07:20:17.559131 run osmo-hlr_10.42.42.2(pid=6520): Launched 07:20:17.688077 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:18.266350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Launched 07:20:18.601493 run osmo-stp_10.42.42.5(pid=6523): Launched 07:20:18.730193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:19.303406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6525): Launched 07:20:19.431917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:19.713981 run patchelf(pid=6526): Launched 07:20:19.899469 run osmo-stp_10.42.42.5(pid=6523): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] 07:20:20.039250 run osmo-stp_10.42.42.5(pid=6523): stdout: | (launched: 2022-12-09_07:20:18.539600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:20.180200 run osmo-stp_10.42.42.5(pid=6523): stderr: | 20221209072018729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072018729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072018729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072018730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072018730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072018730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072018730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:20.321317 run osmo-stp_10.42.42.5(pid=6523): stdout: | (launched: 2022-12-09_07:20:18.539600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:20.457119 run osmo-stp_10.42.42.5(pid=6523): stderr: | 20221209072018729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072018729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072018729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072018730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072018730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072018730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072018730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:20.618158 run patchelf(pid=6526): Terminating (SIGINT) 07:20:20.803684 run patchelf(pid=6526): Terminated: ok {rc=0} 07:20:20.937365 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6523): Process ended prematurely: osmo-stp_10.42.42.5(pid=6523) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:20:20.947721 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:20:20.976734 run osmo-hlr_10.42.42.2(pid=6520): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6520)] 07:20:21.026988 run osmo-hlr_10.42.42.2(pid=6520): stdout: | (launched: 2022-12-09_07:20:17.497342) 07:20:21.079086 run osmo-hlr_10.42.42.2(pid=6520): stderr: | 20221209072017695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072017695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072017695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072017695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072017695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072017695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072017706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072017715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072017715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072017715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:21.131479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6509): Terminating (SIGTERM) 07:20:21.173612 run iperf3-srv_10.42.42.10(pid=6510): Terminating (SIGTERM) 07:20:21.215715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6511): Terminating (SIGTERM) 07:20:21.258399 run iperf3-srv_10.42.42.10(pid=6512): Terminating (SIGTERM) 07:20:21.300557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6513): Terminating (SIGTERM) 07:20:21.343058 run iperf3-srv_10.42.42.10(pid=6514): Terminating (SIGTERM) 07:20:21.385014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6515): Terminating (SIGTERM) 07:20:21.427057 run iperf3-srv_10.42.42.10(pid=6516): Terminating (SIGTERM) 07:20:21.469180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6519): Terminating (SIGTERM) 07:20:21.511253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Terminating (SIGTERM) 07:20:21.553399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6525): Terminating (SIGTERM) 07:20:21.595900 --- ParallelTerminationStrategy: PID 6509 died... 07:20:21.616253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6509): Terminated: ok {rc=0} 07:20:21.663294 --- ParallelTerminationStrategy: PID 6510 died... 07:20:21.683141 run iperf3-srv_10.42.42.10(pid=6510): Terminated {rc=256} 07:20:21.729692 --- ParallelTerminationStrategy: PID 6511 died... 07:20:21.749571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6511): Terminated: ok {rc=0} 07:20:21.796170 --- ParallelTerminationStrategy: PID 6512 died... 07:20:21.816528 run iperf3-srv_10.42.42.10(pid=6512): Terminated {rc=256} 07:20:21.862912 --- ParallelTerminationStrategy: PID 6513 died... 07:20:21.882820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6513): Terminated: ok {rc=0} 07:20:21.929212 --- ParallelTerminationStrategy: PID 6514 died... 07:20:21.948770 run iperf3-srv_10.42.42.10(pid=6514): Terminated {rc=256} 07:20:21.995224 --- ParallelTerminationStrategy: PID 6515 died... 07:20:22.015132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6515): Terminated: ok {rc=0} 07:20:22.061514 --- ParallelTerminationStrategy: PID 6516 died... 07:20:22.081685 run iperf3-srv_10.42.42.10(pid=6516): Terminated {rc=256} 07:20:22.128150 --- ParallelTerminationStrategy: PID 6519 died... 07:20:22.147858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6519): Terminated: ok {rc=0} 07:20:22.194268 --- ParallelTerminationStrategy: PID 6522 died... 07:20:22.214147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Terminated: ok {rc=0} 07:20:22.260449 --- ParallelTerminationStrategy: PID 6525 died... 07:20:22.280107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6525): Terminated: ok {rc=0} 07:20:22.368250 bus /gobi_4: Setting Powered False 07:20:23.467996 bus /gobi_4: Setting Powered False 07:20:24.585740 bus /gobi_1: Setting Powered False 07:20:25.685213 bus /gobi_1: Setting Powered False 07:20:26.802117 bus /gobi_0: Setting Powered False 07:20:27.901661 bus /gobi_0: Setting Powered False 07:20:29.017410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:20:30.121507 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.134132 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:20:30.207213 tst ping.py: using LAC 19841 07:20:30.336764 tst ping.py: using RAC 206 07:20:30.464460 tst ping.py: using CellId 19841 07:20:30.595687 tst ping.py: using BVCI 19842 07:20:30.715109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.726866 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.738332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.749815 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.761099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.772461 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.784093 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:30.795492 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:30.922908 tst ping.py:19: start network... 07:20:31.154738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:31.675540 run create_hlr_db(pid=6528): Launched 07:20:31.861291 bus /gobi_6: Setting Powered False 07:20:32.921670 run create_hlr_db(pid=6528): Terminated: ok {rc=0} 07:20:33.385500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6530): Launched 07:20:33.712177 run osmo-hlr_10.42.42.2(pid=6531): Launched 07:20:33.837657 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:34.402684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6533): Launched 07:20:34.729569 run osmo-stp_10.42.42.5(pid=6534): Launched 07:20:34.854106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:35.416207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6536): Launched 07:20:35.541637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:35.817693 run patchelf(pid=6537): Launched 07:20:35.998636 run osmo-stp_10.42.42.5(pid=6534): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6534)] 07:20:36.135788 run osmo-stp_10.42.42.5(pid=6534): stdout: | (launched: 2022-12-09_07:20:34.668627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:36.274707 run osmo-stp_10.42.42.5(pid=6534): stderr: | 20221209072034863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072034863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072034863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072034863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072034864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072034864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072034864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:36.414827 run osmo-stp_10.42.42.5(pid=6534): stdout: | (launched: 2022-12-09_07:20:34.668627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:36.548277 run osmo-stp_10.42.42.5(pid=6534): stderr: | 20221209072034863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072034863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072034863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072034863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072034864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072034864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072034864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:36.706790 run patchelf(pid=6537): Terminating (SIGINT) 07:20:36.887890 run patchelf(pid=6537): Terminated: ok {rc=0} 07:20:37.018647 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6534): Process ended prematurely: osmo-stp_10.42.42.5(pid=6534) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6534)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 07:20:37.028455 tst ping.py:22: Test FAILED (6.9 sec) 07:20:37.056831 run osmo-hlr_10.42.42.2(pid=6531): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6531)] 07:20:37.107599 run osmo-hlr_10.42.42.2(pid=6531): stdout: | (launched: 2022-12-09_07:20:33.651583) 07:20:37.159963 run osmo-hlr_10.42.42.2(pid=6531): stderr: | 20221209072033850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072033850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072033850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072033851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072033851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072033851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072033863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072033871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072033872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072033872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:37.213283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6530): Terminating (SIGTERM) 07:20:37.255353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6533): Terminating (SIGTERM) 07:20:37.297584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6536): Terminating (SIGTERM) 07:20:37.340392 --- ParallelTerminationStrategy: PID 6530 died... 07:20:37.360690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6530): Terminated: ok {rc=0} 07:20:37.407686 --- ParallelTerminationStrategy: PID 6533 died... 07:20:37.427510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6533): Terminated: ok {rc=0} 07:20:37.473837 --- ParallelTerminationStrategy: PID 6536 died... 07:20:37.493646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6536): Terminated: ok {rc=0} 07:20:37.581566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:20:38.670487 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:38.682832 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:20:38.756397 tst ping_idle_ping.py: using LAC 19842 07:20:38.885309 tst ping_idle_ping.py: using RAC 207 07:20:39.015836 tst ping_idle_ping.py: using CellId 19842 07:20:39.144830 tst ping_idle_ping.py: using BVCI 19843 07:20:39.257894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.269429 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.280391 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.292202 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.303901 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.315954 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.327816 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:20:39.339380 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:20:39.458019 tst ping_idle_ping.py:24: start network... 07:20:39.665214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:40.150321 run create_hlr_db(pid=6538): Launched 07:20:40.269763 bus /gobi_6: Setting Powered False 07:20:41.331051 run create_hlr_db(pid=6538): Terminated: ok {rc=0} 07:20:41.780030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6540): Launched 07:20:42.109150 run osmo-hlr_10.42.42.2(pid=6541): Launched 07:20:42.234672 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:42.805637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6543): Launched 07:20:43.133895 run osmo-stp_10.42.42.5(pid=6544): Launched 07:20:43.260734 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:43.825936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6546): Launched 07:20:43.950542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:44.228054 run patchelf(pid=6547): Launched 07:20:44.412104 run osmo-stp_10.42.42.5(pid=6544): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6544)] 07:20:44.550631 run osmo-stp_10.42.42.5(pid=6544): stdout: | (launched: 2022-12-09_07:20:43.072816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:44.691300 run osmo-stp_10.42.42.5(pid=6544): stderr: | 20221209072043265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072043265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072043265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072043266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072043266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072043266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072043266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:44.831381 run osmo-stp_10.42.42.5(pid=6544): stdout: | (launched: 2022-12-09_07:20:43.072816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:44.966516 run osmo-stp_10.42.42.5(pid=6544): stderr: | 20221209072043265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072043265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072043265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072043266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072043266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072043266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072043266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:45.125985 run patchelf(pid=6547): Terminating (SIGINT) 07:20:45.307921 run patchelf(pid=6547): Terminated: ok {rc=0} 07:20:45.439978 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6544): Process ended prematurely: osmo-stp_10.42.42.5(pid=6544) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6544)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:20:45.449692 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:20:45.477886 run osmo-hlr_10.42.42.2(pid=6541): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6541)] 07:20:45.528577 run osmo-hlr_10.42.42.2(pid=6541): stdout: | (launched: 2022-12-09_07:20:42.047676) 07:20:45.581095 run osmo-hlr_10.42.42.2(pid=6541): stderr: | 20221209072042247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072042247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072042247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072042247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072042247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072042247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072042262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072042272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072042272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072042272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:45.633653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6540): Terminating (SIGTERM) 07:20:45.675690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6543): Terminating (SIGTERM) 07:20:45.717940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6546): Terminating (SIGTERM) 07:20:45.760267 --- ParallelTerminationStrategy: PID 6540 died... 07:20:45.780405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6540): Terminated: ok {rc=0} 07:20:45.827263 --- ParallelTerminationStrategy: PID 6543 died... 07:20:45.850344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6543): Terminated: ok {rc=0} 07:20:45.900574 --- ParallelTerminationStrategy: PID 6546 died... 07:20:45.932893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6546): Terminated: ok {rc=0} 07:20:46.021989 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:20:47.353358 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:20:47.361450 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:20:47.396072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:20:47.436413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:20:47.527007 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:20:47.561457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:20:47.601365 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:20:48.200478 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:20:48.254119 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.265832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:20:48.339085 tst cs_paging_gprs_active.py: using LAC 19843 07:20:48.470829 tst cs_paging_gprs_active.py: using RAC 208 07:20:48.603488 tst cs_paging_gprs_active.py: using CellId 19843 07:20:48.733431 tst cs_paging_gprs_active.py: using BVCI 19844 07:20:48.853923 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.865417 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.876682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.888076 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.899311 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.910736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.922251 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.933552 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:48.945002 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:20:49.064181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:20:49.188014 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:20:49.413823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:49.748097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Launched 07:20:50.040412 run iperf3-srv_10.42.42.10(pid=6553): Launched 07:20:50.166877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:20:50.392289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:50.728002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6554): Launched 07:20:51.018808 run iperf3-srv_10.42.42.10(pid=6555): Launched 07:20:51.146255 tst cs_paging_gprs_active.py:38: start network... 07:20:51.371335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:51.889383 run create_hlr_db(pid=6556): Launched 07:20:52.023895 bus /gobi_6: Setting Powered False 07:20:53.090519 run create_hlr_db(pid=6556): Terminated: ok {rc=0} 07:20:53.555258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Launched 07:20:53.888692 run osmo-hlr_10.42.42.2(pid=6559): Launched 07:20:54.015757 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:54.589476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Launched 07:20:54.923410 run osmo-stp_10.42.42.5(pid=6562): Launched 07:20:55.051463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:55.628365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6564): Launched 07:20:55.755035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:56.037572 run patchelf(pid=6565): Launched 07:20:56.222904 run osmo-stp_10.42.42.5(pid=6562): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] 07:20:56.363689 run osmo-stp_10.42.42.5(pid=6562): stdout: | (launched: 2022-12-09_07:20:54.861874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:56.505495 run osmo-stp_10.42.42.5(pid=6562): stderr: | 20221209072055056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072055056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072055056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072055057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072055057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072055057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072055057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:56.647395 run osmo-stp_10.42.42.5(pid=6562): stdout: | (launched: 2022-12-09_07:20:54.861874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:56.783629 run osmo-stp_10.42.42.5(pid=6562): stderr: | 20221209072055056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072055056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072055056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072055057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072055057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072055057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072055057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:56.945115 run patchelf(pid=6565): Terminating (SIGINT) 07:20:57.131441 run patchelf(pid=6565): Terminated: ok {rc=0} 07:20:57.265578 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6562): Process ended prematurely: osmo-stp_10.42.42.5(pid=6562) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:20:57.275899 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 07:20:57.304655 run osmo-hlr_10.42.42.2(pid=6559): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6559)] 07:20:57.355624 run osmo-hlr_10.42.42.2(pid=6559): stdout: | (launched: 2022-12-09_07:20:53.827319) 07:20:57.408019 run osmo-hlr_10.42.42.2(pid=6559): stderr: | 20221209072054028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072054028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072054028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072054028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072054028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072054028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072054043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072054053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072054054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072054054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:57.460600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Terminating (SIGTERM) 07:20:57.503057 run iperf3-srv_10.42.42.10(pid=6553): Terminating (SIGTERM) 07:20:57.545181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6554): Terminating (SIGTERM) 07:20:57.587159 run iperf3-srv_10.42.42.10(pid=6555): Terminating (SIGTERM) 07:20:57.629003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Terminating (SIGTERM) 07:20:57.670976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Terminating (SIGTERM) 07:20:57.712816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6564): Terminating (SIGTERM) 07:20:57.755045 --- ParallelTerminationStrategy: PID 6552 died... 07:20:57.775241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Terminated: ok {rc=0} 07:20:57.822304 --- ParallelTerminationStrategy: PID 6553 died... 07:20:57.841924 run iperf3-srv_10.42.42.10(pid=6553): Terminated {rc=256} 07:20:57.888307 --- ParallelTerminationStrategy: PID 6554 died... 07:20:57.908111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6554): Terminated: ok {rc=0} 07:20:57.954484 --- ParallelTerminationStrategy: PID 6555 died... 07:20:57.974067 run iperf3-srv_10.42.42.10(pid=6555): Terminated {rc=256} 07:20:58.020339 --- ParallelTerminationStrategy: PID 6558 died... 07:20:58.040040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Terminated: ok {rc=0} 07:20:58.086305 --- ParallelTerminationStrategy: PID 6561 died... 07:20:58.106006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Terminated: ok {rc=0} 07:20:58.152296 --- ParallelTerminationStrategy: PID 6564 died... 07:20:58.171969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6564): Terminated: ok {rc=0} 07:20:58.259948 bus /gobi_0: Setting Powered False 07:20:59.361421 bus /gobi_0: Setting Powered False 07:21:00.478334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:21:01.629671 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:01.642915 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:21:01.721602 tst iperf3.py: using LAC 19844 07:21:01.857574 tst iperf3.py: using RAC 209 07:21:02.022278 tst iperf3.py: using CellId 19844 07:21:02.149327 tst iperf3.py: using BVCI 19845 07:21:02.264244 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.275804 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.286670 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.298386 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.310019 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.321854 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.333739 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.345329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:02.357024 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:02.480669 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:21:02.706239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:03.040415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6566): Launched 07:21:03.331956 run iperf3-srv_10.42.42.10(pid=6567): Launched 07:21:03.458660 tst iperf3.py:8: start network... 07:21:03.683471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:04.199392 run create_hlr_db(pid=6568): Launched 07:21:04.333455 bus /gobi_6: Setting Powered False 07:21:05.399483 run create_hlr_db(pid=6568): Terminated: ok {rc=0} 07:21:05.860202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6570): Launched 07:21:06.195401 run osmo-hlr_10.42.42.2(pid=6571): Launched 07:21:06.322404 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:06.894951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6573): Launched 07:21:07.228152 run osmo-stp_10.42.42.5(pid=6574): Launched 07:21:07.355511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:07.929059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6576): Launched 07:21:08.057156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:08.338819 run patchelf(pid=6577): Launched 07:21:08.521496 run osmo-stp_10.42.42.5(pid=6574): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6574)] 07:21:08.660149 run osmo-stp_10.42.42.5(pid=6574): stdout: | (launched: 2022-12-09_07:21:07.166808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:08.800043 run osmo-stp_10.42.42.5(pid=6574): stderr: | 20221209072107360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072107360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072107361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072107361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072107362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072107362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072107362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:08.940303 run osmo-stp_10.42.42.5(pid=6574): stdout: | (launched: 2022-12-09_07:21:07.166808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:09.074775 run osmo-stp_10.42.42.5(pid=6574): stderr: | 20221209072107360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072107360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072107361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072107361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072107362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072107362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072107362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:09.235191 run patchelf(pid=6577): Terminating (SIGINT) 07:21:09.419314 run patchelf(pid=6577): Terminated: ok {rc=0} 07:21:09.551883 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6574): Process ended prematurely: osmo-stp_10.42.42.5(pid=6574) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6574)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 07:21:09.562354 tst iperf3.py:8: Test FAILED (8.0 sec) 07:21:09.590925 run osmo-hlr_10.42.42.2(pid=6571): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6571)] 07:21:09.641091 run osmo-hlr_10.42.42.2(pid=6571): stdout: | (launched: 2022-12-09_07:21:06.134334) 07:21:09.692846 run osmo-hlr_10.42.42.2(pid=6571): stderr: | 20221209072106332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072106332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072106332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072106332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072106332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072106332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072106347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072106357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072106357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072106357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:09.745059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6566): Terminating (SIGTERM) 07:21:09.786686 run iperf3-srv_10.42.42.10(pid=6567): Terminating (SIGTERM) 07:21:09.828253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6570): Terminating (SIGTERM) 07:21:09.870080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6573): Terminating (SIGTERM) 07:21:09.911871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6576): Terminating (SIGTERM) 07:21:09.954312 --- ParallelTerminationStrategy: PID 6566 died... 07:21:09.974395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6566): Terminated: ok {rc=0} 07:21:10.021154 --- ParallelTerminationStrategy: PID 6567 died... 07:21:10.040801 run iperf3-srv_10.42.42.10(pid=6567): Terminated {rc=256} 07:21:10.086999 --- ParallelTerminationStrategy: PID 6570 died... 07:21:10.106790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6570): Terminated: ok {rc=0} 07:21:10.153319 --- ParallelTerminationStrategy: PID 6573 died... 07:21:10.173045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6573): Terminated: ok {rc=0} 07:21:10.219312 --- ParallelTerminationStrategy: PID 6576 died... 07:21:10.239013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6576): Terminated: ok {rc=0} 07:21:10.327343 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:21:11.481056 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:11.493280 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:21:11.565936 tst iperf3m4.py: using LAC 19845 07:21:11.697740 tst iperf3m4.py: using RAC 210 07:21:11.829038 tst iperf3m4.py: using CellId 19845 07:21:11.960210 tst iperf3m4.py: using BVCI 19846 07:21:12.080688 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.092329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.103825 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.115219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.126423 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.137828 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.149339 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.160568 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:12.172030 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:12.293686 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:12.417501 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:12.537806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:12.655546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:21:12.866211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:13.179741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6578): Launched 07:21:13.452374 run iperf3-srv_10.42.42.10(pid=6579): Launched 07:21:13.568925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:21:13.777707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:14.091069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6580): Launched 07:21:14.363737 run iperf3-srv_10.42.42.10(pid=6581): Launched 07:21:14.479359 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:21:14.687744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:15.000369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6582): Launched 07:21:15.273799 run iperf3-srv_10.42.42.10(pid=6583): Launched 07:21:15.390115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:21:15.597763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:15.912555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Launched 07:21:16.237638 run iperf3-srv_10.42.42.10(pid=6585): Launched 07:21:16.363308 tst iperf3m4.py:8: start network... 07:21:16.576288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:17.070424 run create_hlr_db(pid=6586): Launched 07:21:17.230185 bus /gobi_6: Setting Powered False 07:21:18.291851 run create_hlr_db(pid=6586): Terminated: ok {rc=0} 07:21:18.725298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6588): Launched 07:21:19.039141 run osmo-hlr_10.42.42.2(pid=6589): Launched 07:21:19.160928 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:19.695890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6591): Launched 07:21:20.007043 run osmo-stp_10.42.42.5(pid=6592): Launched 07:21:20.127492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:20.663185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6594): Launched 07:21:20.783085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:21.047831 run patchelf(pid=6595): Launched 07:21:21.222021 run osmo-stp_10.42.42.5(pid=6592): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6592)] 07:21:21.354551 run osmo-stp_10.42.42.5(pid=6592): stdout: | (launched: 2022-12-09_07:21:19.949285) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:21.488192 run osmo-stp_10.42.42.5(pid=6592): stderr: | 20221209072120116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072120117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072120117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072120117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072120118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072120118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072120118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:21.621993 run osmo-stp_10.42.42.5(pid=6592): stdout: | (launched: 2022-12-09_07:21:19.949285) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:21.749791 run osmo-stp_10.42.42.5(pid=6592): stderr: | 20221209072120116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072120117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072120117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072120117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072120118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072120118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072120118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:21.921776 run patchelf(pid=6595): Terminating (SIGINT) 07:21:22.095652 run patchelf(pid=6595): Terminated: ok {rc=0} 07:21:22.220275 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6592): Process ended prematurely: osmo-stp_10.42.42.5(pid=6592) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6592)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:21:22.229982 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:21:22.258094 run osmo-hlr_10.42.42.2(pid=6589): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6589)] 07:21:22.306799 run osmo-hlr_10.42.42.2(pid=6589): stdout: | (launched: 2022-12-09_07:21:18.980717) 07:21:22.357106 run osmo-hlr_10.42.42.2(pid=6589): stderr: | 20221209072119154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072119154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072119154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072119154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072119154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072119155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072119169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072119179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072119179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072119179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:22.407603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6578): Terminating (SIGTERM) 07:21:22.447876 run iperf3-srv_10.42.42.10(pid=6579): Terminating (SIGTERM) 07:21:22.488105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6580): Terminating (SIGTERM) 07:21:22.528259 run iperf3-srv_10.42.42.10(pid=6581): Terminating (SIGTERM) 07:21:22.568597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6582): Terminating (SIGTERM) 07:21:22.609009 run iperf3-srv_10.42.42.10(pid=6583): Terminating (SIGTERM) 07:21:22.649259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Terminating (SIGTERM) 07:21:22.690104 run iperf3-srv_10.42.42.10(pid=6585): Terminating (SIGTERM) 07:21:22.730610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6588): Terminating (SIGTERM) 07:21:22.771051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6591): Terminating (SIGTERM) 07:21:22.811452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6594): Terminating (SIGTERM) 07:21:22.852062 --- ParallelTerminationStrategy: PID 6578 died... 07:21:22.871409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6578): Terminated: ok {rc=0} 07:21:22.916287 --- ParallelTerminationStrategy: PID 6579 died... 07:21:22.935148 run iperf3-srv_10.42.42.10(pid=6579): Terminated {rc=256} 07:21:22.979995 --- ParallelTerminationStrategy: PID 6580 died... 07:21:22.999232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6580): Terminated: ok {rc=0} 07:21:23.044104 --- ParallelTerminationStrategy: PID 6581 died... 07:21:23.062855 run iperf3-srv_10.42.42.10(pid=6581): Terminated {rc=256} 07:21:23.108021 --- ParallelTerminationStrategy: PID 6582 died... 07:21:23.126882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6582): Terminated: ok {rc=0} 07:21:23.171667 --- ParallelTerminationStrategy: PID 6583 died... 07:21:23.190365 run iperf3-srv_10.42.42.10(pid=6583): Terminated {rc=256} 07:21:23.235054 --- ParallelTerminationStrategy: PID 6584 died... 07:21:23.254174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Terminated: ok {rc=0} 07:21:23.299072 --- ParallelTerminationStrategy: PID 6585 died... 07:21:23.317986 run iperf3-srv_10.42.42.10(pid=6585): Terminated {rc=256} 07:21:23.362879 --- ParallelTerminationStrategy: PID 6588 died... 07:21:23.381690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6588): Terminated: ok {rc=0} 07:21:23.426604 --- ParallelTerminationStrategy: PID 6591 died... 07:21:23.445420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6591): Terminated: ok {rc=0} 07:21:23.490273 --- ParallelTerminationStrategy: PID 6594 died... 07:21:23.509181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6594): Terminated: ok {rc=0} 07:21:23.596571 bus /gobi_4: Setting Powered False 07:21:24.697626 bus /gobi_4: Setting Powered False 07:21:25.814482 bus /gobi_1: Setting Powered False 07:21:26.914972 bus /gobi_1: Setting Powered False 07:21:28.032303 bus /gobi_0: Setting Powered False 07:21:29.131194 bus /gobi_0: Setting Powered False 07:21:30.249071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:21:31.360367 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:31.377535 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:21:31.469616 tst ping.py: using LAC 19846 07:21:31.591310 tst ping.py: using RAC 211 07:21:31.721712 tst ping.py: using CellId 19846 07:21:31.850486 tst ping.py: using BVCI 19847 07:21:32.014027 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.030051 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.045363 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.059846 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.073345 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.085806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.099180 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:32.113419 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:32.236063 tst ping.py:19: start network... 07:21:32.442279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:32.916518 run create_hlr_db(pid=6596): Launched 07:21:33.033100 bus /gobi_6: Setting Powered False 07:21:34.093586 run create_hlr_db(pid=6596): Terminated: ok {rc=0} 07:21:34.520484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6598): Launched 07:21:34.828453 run osmo-hlr_10.42.42.2(pid=6599): Launched 07:21:34.946408 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:35.486793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6601): Launched 07:21:35.793387 run osmo-stp_10.42.42.5(pid=6602): Launched 07:21:35.910183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:36.435705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6604): Launched 07:21:36.552445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:36.811009 run patchelf(pid=6605): Launched 07:21:36.982124 run osmo-stp_10.42.42.5(pid=6602): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6602)] 07:21:37.111203 run osmo-stp_10.42.42.5(pid=6602): stdout: | (launched: 2022-12-09_07:21:35.736252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:37.241400 run osmo-stp_10.42.42.5(pid=6602): stderr: | 20221209072135905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072135905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072135905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072135906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072135906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072135906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072135907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:37.372047 run osmo-stp_10.42.42.5(pid=6602): stdout: | (launched: 2022-12-09_07:21:35.736252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:37.497140 run osmo-stp_10.42.42.5(pid=6602): stderr: | 20221209072135905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072135905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072135905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072135906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072135906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072135906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072135907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:37.645403 run patchelf(pid=6605): Terminating (SIGINT) 07:21:37.814694 run patchelf(pid=6605): Terminated: ok {rc=0} 07:21:37.936854 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6602): Process ended prematurely: osmo-stp_10.42.42.5(pid=6602) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6602)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 07:21:37.945988 tst ping.py:22: Test FAILED (6.6 sec) 07:21:37.973040 run osmo-hlr_10.42.42.2(pid=6599): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6599)] 07:21:38.021713 run osmo-hlr_10.42.42.2(pid=6599): stdout: | (launched: 2022-12-09_07:21:34.771286) 07:21:38.071491 run osmo-hlr_10.42.42.2(pid=6599): stderr: | 20221209072134946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072134946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072134946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072134946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072134946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072134946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072134959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072134967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072134968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072134968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:38.121874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6598): Terminating (SIGTERM) 07:21:38.162038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6601): Terminating (SIGTERM) 07:21:38.202261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6604): Terminating (SIGTERM) 07:21:38.242711 --- ParallelTerminationStrategy: PID 6598 died... 07:21:38.262021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6598): Terminated: ok {rc=0} 07:21:38.306588 --- ParallelTerminationStrategy: PID 6601 died... 07:21:38.325140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6601): Terminated: ok {rc=0} 07:21:38.369423 --- ParallelTerminationStrategy: PID 6604 died... 07:21:38.387939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6604): Terminated: ok {rc=0} 07:21:38.475356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:21:39.563947 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:39.575737 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:21:39.647065 tst ping_idle_ping.py: using LAC 19847 07:21:39.765868 tst ping_idle_ping.py: using RAC 212 07:21:39.885948 tst ping_idle_ping.py: using CellId 19847 07:21:40.006028 tst ping_idle_ping.py: using BVCI 19848 07:21:40.118381 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.129461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.140294 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.151425 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.162348 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.173514 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.184585 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:21:40.195600 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:21:40.316611 tst ping_idle_ping.py:24: start network... 07:21:40.521630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:40.999634 run create_hlr_db(pid=6606): Launched 07:21:41.115982 bus /gobi_6: Setting Powered False 07:21:42.177459 run create_hlr_db(pid=6606): Terminated: ok {rc=0} 07:21:42.627092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6608): Launched 07:21:42.954792 run osmo-hlr_10.42.42.2(pid=6609): Launched 07:21:43.078461 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:43.623766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6611): Launched 07:21:43.930760 run osmo-stp_10.42.42.5(pid=6612): Launched 07:21:44.048117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:44.576140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6614): Launched 07:21:44.701615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:44.979554 run patchelf(pid=6615): Launched 07:21:45.163419 run osmo-stp_10.42.42.5(pid=6612): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6612)] 07:21:45.302089 run osmo-stp_10.42.42.5(pid=6612): stdout: | (launched: 2022-12-09_07:21:43.873816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:45.442934 run osmo-stp_10.42.42.5(pid=6612): stderr: | 20221209072144042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072144042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072144042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072144043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072144043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072144043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072144043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:45.582971 run osmo-stp_10.42.42.5(pid=6612): stdout: | (launched: 2022-12-09_07:21:43.873816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:45.717167 run osmo-stp_10.42.42.5(pid=6612): stderr: | 20221209072144042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072144042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072144042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072144043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072144043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072144043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072144043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:45.884644 run patchelf(pid=6615): Terminating (SIGINT) 07:21:46.062465 run patchelf(pid=6615): Terminated: ok {rc=0} 07:21:46.190715 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6612): Process ended prematurely: osmo-stp_10.42.42.5(pid=6612) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6612)] [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:21:46.201103 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:21:46.231846 run osmo-hlr_10.42.42.2(pid=6609): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6609)] 07:21:46.283529 run osmo-hlr_10.42.42.2(pid=6609): stdout: | (launched: 2022-12-09_07:21:42.894135) 07:21:46.336851 run osmo-hlr_10.42.42.2(pid=6609): stderr: | 20221209072143072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072143072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072143072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072143072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072143072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072143073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072143087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072143096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072143096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072143096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:46.392150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6608): Terminating (SIGTERM) 07:21:46.435750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6611): Terminating (SIGTERM) 07:21:46.481132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6614): Terminating (SIGTERM) 07:21:46.526956 --- ParallelTerminationStrategy: PID 6608 died... 07:21:46.547254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6608): Terminated: ok {rc=0} 07:21:46.598469 --- ParallelTerminationStrategy: PID 6611 died... 07:21:46.619139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6611): Terminated: ok {rc=0} 07:21:46.668434 --- ParallelTerminationStrategy: PID 6614 died... 07:21:46.688622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6614): Terminated: ok {rc=0} 07:21:46.780021 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:21:48.096654 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:21:48.103660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:21:48.138868 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 07:21:48.179132 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 07:21:48.271783 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:21:48.306462 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 07:21:48.345526 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 07:21:48.949117 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 07:21:49.001320 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.013063 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:21:49.066125 tst cs_paging_gprs_active.py: using LAC 19848 07:21:49.188834 tst cs_paging_gprs_active.py: using RAC 213 07:21:49.310199 tst cs_paging_gprs_active.py: using CellId 19848 07:21:49.433391 tst cs_paging_gprs_active.py: using BVCI 19849 07:21:49.546918 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.558740 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.570080 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.581662 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.593199 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.604719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.616828 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.628463 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:49.640811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:21:49.765107 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:21:49.885568 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:21:50.095823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:50.409745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Launched 07:21:50.681211 run iperf3-srv_10.42.42.10(pid=6620): Launched 07:21:50.797919 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:21:51.006547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:51.319302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Launched 07:21:51.593841 run iperf3-srv_10.42.42.10(pid=6622): Launched 07:21:51.710573 tst cs_paging_gprs_active.py:38: start network... 07:21:51.919339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:52.402375 run create_hlr_db(pid=6623): Launched 07:21:52.520697 bus /gobi_6: Setting Powered False 07:21:53.582819 run create_hlr_db(pid=6623): Terminated: ok {rc=0} 07:21:54.038870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Launched 07:21:54.372677 run osmo-hlr_10.42.42.2(pid=6626): Launched 07:21:54.499466 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:55.059331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Launched 07:21:55.371579 run osmo-stp_10.42.42.5(pid=6629): Launched 07:21:55.490180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:56.028609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Launched 07:21:56.149194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:56.413371 run patchelf(pid=6632): Launched 07:21:56.586158 run osmo-stp_10.42.42.5(pid=6629): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] 07:21:56.717143 run osmo-stp_10.42.42.5(pid=6629): stdout: | (launched: 2022-12-09_07:21:55.312564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:56.850181 run osmo-stp_10.42.42.5(pid=6629): stderr: | 20221209072155482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072155482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072155483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072155483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072155483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072155483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072155484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:56.982736 run osmo-stp_10.42.42.5(pid=6629): stdout: | (launched: 2022-12-09_07:21:55.312564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:57.110154 run osmo-stp_10.42.42.5(pid=6629): stderr: | 20221209072155482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072155482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072155483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072155483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072155483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072155483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072155484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:57.261113 run patchelf(pid=6632): Terminating (SIGINT) 07:21:57.433895 run patchelf(pid=6632): Terminated: ok {rc=0} 07:21:57.559655 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6629): Process ended prematurely: osmo-stp_10.42.42.5(pid=6629) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 07:21:57.569528 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:21:57.597685 run osmo-hlr_10.42.42.2(pid=6626): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6626)] 07:21:57.646290 run osmo-hlr_10.42.42.2(pid=6626): stdout: | (launched: 2022-12-09_07:21:54.310473) 07:21:57.696627 run osmo-hlr_10.42.42.2(pid=6626): stderr: | 20221209072154511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072154511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072154511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072154511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072154511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072154511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072154524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072154532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072154532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072154532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:57.747531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Terminating (SIGTERM) 07:21:57.788065 run iperf3-srv_10.42.42.10(pid=6620): Terminating (SIGTERM) 07:21:57.828808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Terminating (SIGTERM) 07:21:57.869322 run iperf3-srv_10.42.42.10(pid=6622): Terminating (SIGTERM) 07:21:57.909722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Terminating (SIGTERM) 07:21:57.950164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Terminating (SIGTERM) 07:21:57.991193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Terminating (SIGTERM) 07:21:58.031870 --- ParallelTerminationStrategy: PID 6619 died... 07:21:58.051119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Terminated: ok {rc=0} 07:21:58.096274 --- ParallelTerminationStrategy: PID 6620 died... 07:21:58.115125 run iperf3-srv_10.42.42.10(pid=6620): Terminated {rc=256} 07:21:58.160214 --- ParallelTerminationStrategy: PID 6621 died... 07:21:58.179045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Terminated: ok {rc=0} 07:21:58.223716 --- ParallelTerminationStrategy: PID 6622 died... 07:21:58.242410 run iperf3-srv_10.42.42.10(pid=6622): Terminated {rc=256} 07:21:58.287085 --- ParallelTerminationStrategy: PID 6625 died... 07:21:58.305910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Terminated: ok {rc=0} 07:21:58.350874 --- ParallelTerminationStrategy: PID 6628 died... 07:21:58.369849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Terminated: ok {rc=0} 07:21:58.414564 --- ParallelTerminationStrategy: PID 6631 died... 07:21:58.433523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Terminated: ok {rc=0} 07:21:58.521121 bus /gobi_0: Setting Powered False 07:21:59.622113 bus /gobi_0: Setting Powered False 07:22:00.738705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 07:22:01.911236 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:01.924440 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:22:01.982528 tst iperf3.py: using LAC 19849 07:22:02.141420 tst iperf3.py: using RAC 214 07:22:02.275545 tst iperf3.py: using CellId 19849 07:22:02.398244 tst iperf3.py: using BVCI 19850 07:22:02.513640 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.525288 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.536478 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.548512 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.560754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.572818 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.584737 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.596641 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:02.608649 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:02.734446 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:22:02.944650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:03.257403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Launched 07:22:03.528641 run iperf3-srv_10.42.42.10(pid=6634): Launched 07:22:03.646253 tst iperf3.py:8: start network... 07:22:03.855079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:04.337596 run create_hlr_db(pid=6635): Launched 07:22:04.457686 bus /gobi_6: Setting Powered False 07:22:05.518919 run create_hlr_db(pid=6635): Terminated: ok {rc=0} 07:22:05.952920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Launched 07:22:06.265523 run osmo-hlr_10.42.42.2(pid=6638): Launched 07:22:06.384188 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:06.936674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Launched 07:22:07.249712 run osmo-stp_10.42.42.5(pid=6641): Launched 07:22:07.367355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:07.903189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6643): Launched 07:22:08.023616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:08.287447 run patchelf(pid=6644): Launched 07:22:08.461732 run osmo-stp_10.42.42.5(pid=6641): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] 07:22:08.592908 run osmo-stp_10.42.42.5(pid=6641): stdout: | (launched: 2022-12-09_07:22:07.191778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:08.725928 run osmo-stp_10.42.42.5(pid=6641): stderr: | 20221209072207364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072207364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072207364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072207365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072207365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072207365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072207366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:08.859259 run osmo-stp_10.42.42.5(pid=6641): stdout: | (launched: 2022-12-09_07:22:07.191778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:08.986471 run osmo-stp_10.42.42.5(pid=6641): stderr: | 20221209072207364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072207364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072207364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072207365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072207365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072207365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072207366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:09.137697 run patchelf(pid=6644): Terminating (SIGINT) 07:22:09.311296 run patchelf(pid=6644): Terminated: ok {rc=0} 07:22:09.436506 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6641): Process ended prematurely: osmo-stp_10.42.42.5(pid=6641) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 07:22:09.446275 tst iperf3.py:8: Test FAILED (7.6 sec) 07:22:09.474071 run osmo-hlr_10.42.42.2(pid=6638): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6638)] 07:22:09.522770 run osmo-hlr_10.42.42.2(pid=6638): stdout: | (launched: 2022-12-09_07:22:06.207632) 07:22:09.573181 run osmo-hlr_10.42.42.2(pid=6638): stderr: | 20221209072206386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072206386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072206386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072206386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072206386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072206386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072206398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072206409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072206409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072206409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:09.623971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Terminating (SIGTERM) 07:22:09.664401 run iperf3-srv_10.42.42.10(pid=6634): Terminating (SIGTERM) 07:22:09.704641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Terminating (SIGTERM) 07:22:09.745051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Terminating (SIGTERM) 07:22:09.785380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6643): Terminating (SIGTERM) 07:22:09.825909 --- ParallelTerminationStrategy: PID 6633 died... 07:22:09.845193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Terminated: ok {rc=0} 07:22:09.889725 --- ParallelTerminationStrategy: PID 6634 died... 07:22:09.908303 run iperf3-srv_10.42.42.10(pid=6634): Terminated {rc=256} 07:22:09.952933 --- ParallelTerminationStrategy: PID 6637 died... 07:22:09.972139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Terminated: ok {rc=0} 07:22:10.016729 --- ParallelTerminationStrategy: PID 6640 died... 07:22:10.035474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Terminated: ok {rc=0} 07:22:10.080226 --- ParallelTerminationStrategy: PID 6643 died... 07:22:10.099133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6643): Terminated: ok {rc=0} 07:22:10.183988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 07:22:11.335638 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.348519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:22:11.406784 tst iperf3m4.py: using LAC 19850 07:22:11.537435 tst iperf3m4.py: using RAC 215 07:22:11.673607 tst iperf3m4.py: using CellId 19850 07:22:11.803143 tst iperf3m4.py: using BVCI 19851 07:22:11.923626 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.935646 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.947469 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.959300 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.971226 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.982977 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:11.994926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:12.006660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:12.018714 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:12.142205 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:12.268907 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:12.393635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:12.514627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:22:12.738396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:13.071918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Launched 07:22:13.361888 run iperf3-srv_10.42.42.10(pid=6646): Launched 07:22:13.486907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:22:13.712506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:14.048081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Launched 07:22:14.337146 run iperf3-srv_10.42.42.10(pid=6648): Launched 07:22:14.464039 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:22:14.688693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:15.023424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Launched 07:22:15.312058 run iperf3-srv_10.42.42.10(pid=6650): Launched 07:22:15.438298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:22:15.662746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:16.015039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Launched 07:22:16.321690 run iperf3-srv_10.42.42.10(pid=6652): Launched 07:22:16.452113 tst iperf3m4.py:8: start network... 07:22:16.668402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:17.189570 run create_hlr_db(pid=6653): Launched 07:22:17.324841 bus /gobi_6: Setting Powered False 07:22:18.390815 run create_hlr_db(pid=6653): Terminated: ok {rc=0} 07:22:18.833658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6655): Launched 07:22:19.144576 run osmo-hlr_10.42.42.2(pid=6656): Launched 07:22:19.263564 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:19.817659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6658): Launched 07:22:20.130221 run osmo-stp_10.42.42.5(pid=6659): Launched 07:22:20.249756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:20.784776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6661): Launched 07:22:20.904723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:21.167733 run patchelf(pid=6662): Launched 07:22:21.339928 run osmo-stp_10.42.42.5(pid=6659): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6659)] 07:22:21.471102 run osmo-stp_10.42.42.5(pid=6659): stdout: | (launched: 2022-12-09_07:22:20.071566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:21.603767 run osmo-stp_10.42.42.5(pid=6659): stderr: | 20221209072220240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072220240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072220241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072220241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072220242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072220242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072220242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:21.736645 run osmo-stp_10.42.42.5(pid=6659): stdout: | (launched: 2022-12-09_07:22:20.071566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:21.863774 run osmo-stp_10.42.42.5(pid=6659): stderr: | 20221209072220240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072220240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072220241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072220241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072220242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072220242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072220242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:22.014466 run patchelf(pid=6662): Terminating (SIGINT) 07:22:22.187329 run patchelf(pid=6662): Terminated: ok {rc=0} 07:22:22.312461 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6659): Process ended prematurely: osmo-stp_10.42.42.5(pid=6659) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6659)] [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 07:22:22.322342 tst iperf3m4.py:8: Test FAILED (11.0 sec) 07:22:22.350438 run osmo-hlr_10.42.42.2(pid=6656): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6656)] 07:22:22.399327 run osmo-hlr_10.42.42.2(pid=6656): stdout: | (launched: 2022-12-09_07:22:19.086765) 07:22:22.449273 run osmo-hlr_10.42.42.2(pid=6656): stderr: | 20221209072219262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072219262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072219262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072219262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072219262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072219262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072219273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072219282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072219282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072219282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:22.499364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Terminating (SIGTERM) 07:22:22.539371 run iperf3-srv_10.42.42.10(pid=6646): Terminating (SIGTERM) 07:22:22.579368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminating (SIGTERM) 07:22:22.619664 run iperf3-srv_10.42.42.10(pid=6648): Terminating (SIGTERM) 07:22:22.659704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Terminating (SIGTERM) 07:22:22.699777 run iperf3-srv_10.42.42.10(pid=6650): Terminating (SIGTERM) 07:22:22.739787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Terminating (SIGTERM) 07:22:22.779741 run iperf3-srv_10.42.42.10(pid=6652): Terminating (SIGTERM) 07:22:22.819651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6655): Terminating (SIGTERM) 07:22:22.859732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6658): Terminating (SIGTERM) 07:22:22.899701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6661): Terminating (SIGTERM) 07:22:22.939862 --- ParallelTerminationStrategy: PID 6645 died... 07:22:22.959025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Terminated: ok {rc=0} 07:22:23.003579 --- ParallelTerminationStrategy: PID 6646 died... 07:22:23.022231 run iperf3-srv_10.42.42.10(pid=6646): Terminated {rc=256} 07:22:23.066450 --- ParallelTerminationStrategy: PID 6647 died... 07:22:23.085109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminated: ok {rc=0} 07:22:23.129524 --- ParallelTerminationStrategy: PID 6648 died... 07:22:23.148198 run iperf3-srv_10.42.42.10(pid=6648): Terminated {rc=256} 07:22:23.193079 --- ParallelTerminationStrategy: PID 6649 died... 07:22:23.211727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Terminated: ok {rc=0} 07:22:23.256515 --- ParallelTerminationStrategy: PID 6650 died... 07:22:23.275160 run iperf3-srv_10.42.42.10(pid=6650): Terminated {rc=256} 07:22:23.319187 --- ParallelTerminationStrategy: PID 6651 died... 07:22:23.337819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Terminated: ok {rc=0} 07:22:23.382197 --- ParallelTerminationStrategy: PID 6652 died... 07:22:23.400729 run iperf3-srv_10.42.42.10(pid=6652): Terminated {rc=256} 07:22:23.445036 --- ParallelTerminationStrategy: PID 6655 died... 07:22:23.463711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6655): Terminated: ok {rc=0} 07:22:23.507962 --- ParallelTerminationStrategy: PID 6658 died... 07:22:23.526683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6658): Terminated: ok {rc=0} 07:22:23.570860 --- ParallelTerminationStrategy: PID 6661 died... 07:22:23.589896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6661): Terminated: ok {rc=0} 07:22:23.675883 bus /gobi_4: Setting Powered False 07:22:24.777266 bus /gobi_4: Setting Powered False 07:22:25.893532 bus /gobi_1: Setting Powered False 07:22:26.992251 bus /gobi_1: Setting Powered False 07:22:28.108762 bus /gobi_0: Setting Powered False 07:22:29.204477 bus /gobi_0: Setting Powered False 07:22:30.320109 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 07:22:31.427327 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:31.443272 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:22:31.499426 tst ping.py: using LAC 19851 07:22:31.629318 tst ping.py: using RAC 216 07:22:31.753322 tst ping.py: using CellId 19851 07:22:31.910233 tst ping.py: using BVCI 19852 07:22:32.028229 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.040832 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.054500 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.067929 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.080139 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.093181 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.106901 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:32.121395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:32.241477 tst ping.py:19: start network... 07:22:32.448249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:32.925145 run create_hlr_db(pid=6663): Launched 07:22:33.043892 bus /gobi_6: Setting Powered False 07:22:34.105493 run create_hlr_db(pid=6663): Terminated: ok {rc=0} 07:22:34.532771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Launched 07:22:34.841431 run osmo-hlr_10.42.42.2(pid=6666): Launched 07:22:34.960223 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:35.501418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Launched 07:22:35.809383 run osmo-stp_10.42.42.5(pid=6675): Launched 07:22:35.935927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:36.505666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6677): Launched 07:22:36.630044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:36.907106 run patchelf(pid=6678): Launched 07:22:37.088601 run osmo-stp_10.42.42.5(pid=6675): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6675)] 07:22:37.226499 run osmo-stp_10.42.42.5(pid=6675): stdout: | (launched: 2022-12-09_07:22:35.750817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:37.366607 run osmo-stp_10.42.42.5(pid=6675): stderr: | 20221209072235944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072235944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072235945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072235945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072235946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072235946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072235946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:37.507187 run osmo-stp_10.42.42.5(pid=6675): stdout: | (launched: 2022-12-09_07:22:35.750817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:37.641260 run osmo-stp_10.42.42.5(pid=6675): stderr: | 20221209072235944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072235944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072235945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072235945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072235946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072235946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072235946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:37.799896 run patchelf(pid=6678): Terminating (SIGINT) 07:22:37.982105 run patchelf(pid=6678): Terminated: ok {rc=0} 07:22:38.112812 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6675): Process ended prematurely: osmo-stp_10.42.42.5(pid=6675) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6675)] [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 07:22:38.122719 tst ping.py:22: Test FAILED (6.7 sec) 07:22:38.151060 run osmo-hlr_10.42.42.2(pid=6666): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6666)] 07:22:38.201417 run osmo-hlr_10.42.42.2(pid=6666): stdout: | (launched: 2022-12-09_07:22:34.783978) 07:22:38.253419 run osmo-hlr_10.42.42.2(pid=6666): stderr: | 20221209072234960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072234960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072234960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072234960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072234960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072234960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072234970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072234979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072234979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072234979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:38.306009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Terminating (SIGTERM) 07:22:38.347864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Terminating (SIGTERM) 07:22:38.390484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6677): Terminating (SIGTERM) 07:22:38.432735 --- ParallelTerminationStrategy: PID 6665 died... 07:22:38.453148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Terminated: ok {rc=0} 07:22:38.499912 --- ParallelTerminationStrategy: PID 6668 died... 07:22:38.519457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Terminated: ok {rc=0} 07:22:38.566084 --- ParallelTerminationStrategy: PID 6677 died... 07:22:38.585747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6677): Terminated: ok {rc=0} 07:22:38.673610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 07:22:39.763138 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:39.777517 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:22:39.833262 tst ping_idle_ping.py: using LAC 19852 07:22:39.963437 tst ping_idle_ping.py: using RAC 217 07:22:40.091331 tst ping_idle_ping.py: using CellId 19852 07:22:40.215598 tst ping_idle_ping.py: using BVCI 19853 07:22:40.329207 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.340887 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.352783 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.364685 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.376639 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.388560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.400680 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:22:40.412688 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:22:40.535803 tst ping_idle_ping.py:24: start network... 07:22:40.757220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:41.270327 run create_hlr_db(pid=6679): Launched 07:22:41.403972 bus /gobi_6: Setting Powered False 07:22:42.469072 run create_hlr_db(pid=6679): Terminated: ok {rc=0} 07:22:42.926010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6681): Launched 07:22:43.254527 run osmo-hlr_10.42.42.2(pid=6682): Launched 07:22:43.381884 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:43.947674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6684): Launched 07:22:44.275894 run osmo-stp_10.42.42.5(pid=6685): Launched 07:22:44.401761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:44.968354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6687): Launched 07:22:45.094648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:45.372919 run patchelf(pid=6688): Launched 07:22:45.555225 run osmo-stp_10.42.42.5(pid=6685): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6685)] 07:22:45.693642 run osmo-stp_10.42.42.5(pid=6685): stdout: | (launched: 2022-12-09_07:22:44.214849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:45.836547 run osmo-stp_10.42.42.5(pid=6685): stderr: | 20221209072244407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072244408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072244408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072244408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072244409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072244409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072244409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:45.982030 run osmo-stp_10.42.42.5(pid=6685): stdout: | (launched: 2022-12-09_07:22:44.214849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:46.112298 run osmo-stp_10.42.42.5(pid=6685): stderr: | 20221209072244407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072244408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072244408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072244408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072244409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072244409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072244409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:46.266919 run patchelf(pid=6688): Terminating (SIGINT) 07:22:46.444281 run patchelf(pid=6688): Terminated: ok {rc=0} 07:22:46.572661 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6685): Process ended prematurely: osmo-stp_10.42.42.5(pid=6685) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6685)] [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 07:22:46.583574 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:22:46.613353 run osmo-hlr_10.42.42.2(pid=6682): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6682)] 07:22:46.665850 run osmo-hlr_10.42.42.2(pid=6682): stdout: | (launched: 2022-12-09_07:22:43.193564) 07:22:46.719334 run osmo-hlr_10.42.42.2(pid=6682): stderr: | 20221209072243394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072243394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072243394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072243394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072243394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072243394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072243406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072243415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072243415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072243415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:46.774878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6681): Terminating (SIGTERM) 07:22:46.818694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6684): Terminating (SIGTERM) 07:22:46.863670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6687): Terminating (SIGTERM) 07:22:46.908919 --- ParallelTerminationStrategy: PID 6681 died... 07:22:46.929089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6681): Terminated: ok {rc=0} 07:22:46.979007 --- ParallelTerminationStrategy: PID 6684 died... 07:22:46.999407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6684): Terminated: ok {rc=0} 07:22:47.047338 --- ParallelTerminationStrategy: PID 6687 died... 07:22:47.067156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6687): Terminated: ok {rc=0} 07:22:47.155697 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:22:48.476581 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:48.483883 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:22:48.518489 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:22:48.554250 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:22:48.609406 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:22:48.644100 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:22:48.680243 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:22:49.240880 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:22:49.246524 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.258516 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:22:49.330873 tst switch_tch_pdch.py: using LAC 19853 07:22:49.461144 tst switch_tch_pdch.py: using RAC 218 07:22:49.587795 tst switch_tch_pdch.py: using CellId 19853 07:22:49.714523 tst switch_tch_pdch.py: using BVCI 19854 07:22:49.834203 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.846118 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.857843 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.869540 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.881193 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.893294 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.905364 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:22:49.917025 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:22:50.035226 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:22:50.157557 tst switch_tch_pdch.py:51: start network... 07:22:50.377599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:50.885437 run create_hlr_db(pid=6693): Launched 07:22:51.017417 bus /gobi_6: Setting Powered False 07:22:52.081886 run create_hlr_db(pid=6693): Terminated: ok {rc=0} 07:22:52.517101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6695): Launched 07:22:52.824395 run osmo-hlr_10.42.42.2(pid=6696): Launched 07:22:52.941216 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:53.471112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6698): Launched 07:22:53.778818 run osmo-stp_10.42.42.5(pid=6699): Launched 07:22:53.895168 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:54.421544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6701): Launched 07:22:54.538203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:54.796729 run patchelf(pid=6702): Launched 07:22:54.966103 run osmo-stp_10.42.42.5(pid=6699): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6699)] 07:22:55.094531 run osmo-stp_10.42.42.5(pid=6699): stdout: | (launched: 2022-12-09_07:22:53.721204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:55.224571 run osmo-stp_10.42.42.5(pid=6699): stderr: | 20221209072253893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072253893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072253893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072253893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072253894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072253894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072253894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:55.354978 run osmo-stp_10.42.42.5(pid=6699): stdout: | (launched: 2022-12-09_07:22:53.721204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:55.480317 run osmo-stp_10.42.42.5(pid=6699): stderr: | 20221209072253893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072253893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072253893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072253893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072253894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072253894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072253894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:55.627985 run patchelf(pid=6702): Terminating (SIGINT) 07:22:55.797195 run patchelf(pid=6702): Terminated: ok {rc=0} 07:22:55.919241 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6699): Process ended prematurely: osmo-stp_10.42.42.5(pid=6699) [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6699)] [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:22:55.928335 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:22:55.955344 run osmo-hlr_10.42.42.2(pid=6696): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6696)] 07:22:56.003622 run osmo-hlr_10.42.42.2(pid=6696): stdout: | (launched: 2022-12-09_07:22:52.766923) 07:22:56.053335 run osmo-hlr_10.42.42.2(pid=6696): stderr: | 20221209072252943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072252944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072252944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072252944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072252944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072252944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072252955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072252966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072252966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072252966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:56.103236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6695): Terminating (SIGTERM) 07:22:56.143483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6698): Terminating (SIGTERM) 07:22:56.183713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6701): Terminating (SIGTERM) 07:22:56.224197 --- ParallelTerminationStrategy: PID 6695 died... 07:22:56.243423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6695): Terminated: ok {rc=0} 07:22:56.287951 --- ParallelTerminationStrategy: PID 6698 died... 07:22:56.306778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6698): Terminated: ok {rc=0} 07:22:56.351095 --- ParallelTerminationStrategy: PID 6701 died... 07:22:56.369947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6701): Terminated: ok {rc=0} 07:22:56.456683 bus /gobi_0: Setting Powered False 07:22:57.557418 bus /gobi_0: Setting Powered False 07:22:58.674652 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:22:59.932702 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:59.938690 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:22:59.972771 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:23:00.007801 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:23:00.059822 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:23:00.093486 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:23:00.128580 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:23:00.686995 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:23:00.692010 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:00.703083 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:23:00.771143 tst switch_tch_pdch.py: using LAC 19854 07:23:00.892334 tst switch_tch_pdch.py: using RAC 219 07:23:01.030933 tst switch_tch_pdch.py: using CellId 19854 07:23:01.191399 tst switch_tch_pdch.py: using BVCI 19855 07:23:01.313701 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.326467 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.338848 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.352006 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.366536 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.380327 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.393869 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:23:01.406718 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:23:01.545398 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:23:01.694981 tst switch_tch_pdch.py:51: start network... 07:23:01.954761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:02.478678 run create_hlr_db(pid=6750): Launched 07:23:02.655398 bus /gobi_6: Setting Powered False 07:23:03.742861 run create_hlr_db(pid=6750): Terminated: ok {rc=0} 07:23:04.224825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6977): Launched 07:23:04.548605 run osmo-hlr_10.42.42.2(pid=6978): Launched 07:23:04.804864 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:05.451084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6980): Launched 07:23:05.797412 run osmo-stp_10.42.42.5(pid=6981): Launched 07:23:06.065667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:23:06.650879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6985): Launched 07:23:06.782158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:23:07.049150 run patchelf(pid=6986): Launched 07:23:07.237473 run osmo-stp_10.42.42.5(pid=6981): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6981)] 07:23:07.369667 run osmo-stp_10.42.42.5(pid=6981): stdout: | (launched: 2022-12-09_07:23:05.734682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:07.504667 run osmo-stp_10.42.42.5(pid=6981): stderr: | 20221209072306023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072306023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072306023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072306023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072306024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072306024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072306024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:07.639533 run osmo-stp_10.42.42.5(pid=6981): stdout: | (launched: 2022-12-09_07:23:05.734682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:07.768440 run osmo-stp_10.42.42.5(pid=6981): stderr: | 20221209072306023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072306023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072306023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072306023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072306024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072306024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072306024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:07.919882 run patchelf(pid=6986): Terminating (SIGINT) 07:23:08.093266 run patchelf(pid=6986): Terminated: ok {rc=0} 07:23:08.218703 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6981): Process ended prematurely: osmo-stp_10.42.42.5(pid=6981) [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6981)] [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:23:08.228731 tst switch_tch_pdch.py:54: Test FAILED (7.5 sec) 07:23:08.259532 run osmo-hlr_10.42.42.2(pid=6978): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6978)] 07:23:08.310637 run osmo-hlr_10.42.42.2(pid=6978): stdout: | (launched: 2022-12-09_07:23:04.488317) 07:23:08.363202 run osmo-hlr_10.42.42.2(pid=6978): stderr: | 20221209072304797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072304797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072304797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072304797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072304797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072304797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072304810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072304818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072304818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072304819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:08.416620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6977): Terminating (SIGTERM) 07:23:08.460035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6980): Terminating (SIGTERM) 07:23:08.505137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6985): Terminating (SIGTERM) 07:23:08.550299 --- ParallelTerminationStrategy: PID 6977 died... 07:23:08.570637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6977): Terminated: ok {rc=0} 07:23:08.620019 --- ParallelTerminationStrategy: PID 6980 died... 07:23:08.640173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6980): Terminated: ok {rc=0} 07:23:08.688283 --- ParallelTerminationStrategy: PID 6985 died... 07:23:08.708257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6985): Terminated: ok {rc=0} 07:23:08.797305 bus /gobi_0: Setting Powered False 07:23:09.899049 bus /gobi_0: Setting Powered False 07:23:11.016058 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 07:23:12.282233 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:12.287879 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:23:12.327922 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 07:23:12.336106 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 07:23:12.389843 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:23:12.426582 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 07:23:12.434405 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 07:23:12.974214 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 07:23:12.980733 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 07:23:12.992844 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:23:13.046027 tst mo_mt_sms.py: using LAC 19855 07:23:13.169308 tst mo_mt_sms.py: using RAC 220 07:23:13.291861 tst mo_mt_sms.py: using CellId 19855 07:23:13.417386 tst mo_mt_sms.py: using BVCI 19856 07:23:13.535794 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:23:13.658534 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:23:13.781537 tst mo_mt_sms.py:9: start nitb and bts... 07:23:13.996558 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:23:14.644495 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6990): Launched 07:23:14.978366 run osmo-nitb_10.42.42.2(pid=6991): Launched 07:23:15.173997 run osmo-nitb_10.42.42.2(pid=6991): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6991)] 07:23:15.316671 run osmo-nitb_10.42.42.2(pid=6991): stdout: | (launched: 2022-12-09_07:23:14.917611) 07:23:15.461482 run osmo-nitb_10.42.42.2(pid=6991): stderr: | (launched: 2022-12-09_07:23:14.965977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:23:15.607705 run osmo-nitb_10.42.42.2(pid=6991): stdout: | (launched: 2022-12-09_07:23:14.917611) 07:23:15.747109 run osmo-nitb_10.42.42.2(pid=6991): stderr: | (launched: 2022-12-09_07:23:14.965977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6991) [trial-2356↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6991)] 07:23:16.117256 tst osmo-nitb_10.42.42.2(pid=6991): stdout: | (launched: 2022-12-09_07:23:14.917611) 07:23:16.285178 tst osmo-nitb_10.42.42.2(pid=6991): stderr: | (launched: 2022-12-09_07:23:14.965977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:23:16.465067 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6991) [trial-2356↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6991)] [trial-2356↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 07:23:16.477108 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 07:23:16.486072 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6990): Terminating (SIGTERM) 07:23:16.706647 --- ParallelTerminationStrategy: PID 6990 died... 07:23:16.732428 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6990): Terminated: ok {rc=0} 07:23:16.880678 bus /sierra_3: Setting Powered False 07:23:17.992789 bus /sierra_3: Setting Powered False 07:23:19.115630 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:trx-sysmocell5000 --------------------------------------------------------------------- 07:23:20.324878 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:20.329795 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:23:20.368616 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:23:20.398071 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 07:23:20.451522 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:23:20.488500 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:23:20.521097 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 07:23:21.066289 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 07:23:21.072873 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:21.084851 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:23:21.139901 tst mo_mt_sms.py: using LAC 19856 07:23:21.265512 tst mo_mt_sms.py: using RAC 221 07:23:21.393397 tst mo_mt_sms.py: using CellId 19856 07:23:21.516893 tst mo_mt_sms.py: using BVCI 19857 07:23:21.634497 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:21.646472 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:21.658606 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:21.671738 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:21.685554 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:21.697326 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:23:21.821269 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:23:21.943048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:22.438081 run create_hlr_db(pid=6995): Launched 07:23:22.607656 bus /sierra_2: Setting Powered False 07:23:23.674561 run create_hlr_db(pid=6995): Terminated: ok {rc=0} 07:23:24.139007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6997): Launched 07:23:24.467254 run osmo-hlr_10.42.42.2(pid=6998): Launched 07:23:24.593539 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:25.155655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7000): Launched 07:23:25.484640 run osmo-stp_10.42.42.5(pid=7001): Launched 07:23:25.610959 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:26.203492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7003): Launched 07:23:26.533171 run osmo-msc_10.42.42.6(pid=7004): Launched 07:23:26.716022 run osmo-stp_10.42.42.5(pid=7001): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7001)] 07:23:26.853527 run osmo-stp_10.42.42.5(pid=7001): stdout: | (launched: 2022-12-09_07:23:25.423681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:26.991677 run osmo-stp_10.42.42.5(pid=7001): stderr: | 20221209072325617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072325618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072325618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072325618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072325619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072325619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072325619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:27.129529 run osmo-stp_10.42.42.5(pid=7001): stdout: | (launched: 2022-12-09_07:23:25.423681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:27.259119 run osmo-stp_10.42.42.5(pid=7001): stderr: | 20221209072325617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072325618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072325618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072325618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072325619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072325619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072325619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:27.414730 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7001): Process ended prematurely: osmo-stp_10.42.42.5(pid=7001) [trial-2356↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7001)] [trial-2356↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 07:23:27.423638 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 07:23:27.451338 run osmo-hlr_10.42.42.2(pid=6998): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6998)] 07:23:27.502283 run osmo-hlr_10.42.42.2(pid=6998): stdout: | (launched: 2022-12-09_07:23:24.405988) 07:23:27.554557 run osmo-hlr_10.42.42.2(pid=6998): stderr: | 20221209072324606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072324606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072324606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072324606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072324606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072324606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072324619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072324627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072324627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072324627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:27.627889 run osmo-msc_10.42.42.6(pid=7004): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7004)] 07:23:27.678379 run osmo-msc_10.42.42.6(pid=7004): stdout: | (launched: 2022-12-09_07:23:26.472248) 07:23:27.730415 run osmo-msc_10.42.42.6(pid=7004): stderr: | 20221209072326798 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072326798 DLGLOBAL DEBUG validating counter group 0x7ff06560fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072326798 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072326798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072326798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072326799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072326800 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072326801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072326801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072326801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:27.782917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6997): Terminating (SIGTERM) 07:23:27.824873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7000): Terminating (SIGTERM) 07:23:27.866850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7003): Terminating (SIGTERM) 07:23:27.909198 --- ParallelTerminationStrategy: PID 6997 died... 07:23:27.929336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6997): Terminated: ok {rc=0} 07:23:27.975946 --- ParallelTerminationStrategy: PID 7000 died... 07:23:27.995534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7000): Terminated: ok {rc=0} 07:23:28.041990 --- ParallelTerminationStrategy: PID 7003 died... 07:23:28.061677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7003): Terminated: ok {rc=0} 07:23:28.150194 bus /sierra_3: Setting Powered False 07:23:29.250944 bus /sierra_3: Setting Powered False 07:23:30.369219 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 07:23:31.613862 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:31.621848 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:23:31.662492 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 07:23:31.670319 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 07:23:31.708534 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:23:31.754461 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 07:23:31.762208 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 07:23:32.273665 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 07:23:32.279783 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 07:23:32.292079 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:23:32.343804 tst assert_extension.py: using LAC 19857 07:23:32.473397 tst assert_extension.py: using RAC 222 07:23:32.602289 tst assert_extension.py: using CellId 19857 07:23:32.731717 tst assert_extension.py: using BVCI 19858 07:23:32.851093 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 07:23:32.973083 tst assert_extension.py:10: start nitb and bts... 07:23:33.193780 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:23:33.864295 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7009): Launched 07:23:34.192080 run osmo-nitb_10.42.42.2(pid=7010): Launched 07:23:34.374849 run osmo-nitb_10.42.42.2(pid=7010): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7010)] 07:23:34.520732 run osmo-nitb_10.42.42.2(pid=7010): stdout: | (launched: 2022-12-09_07:23:34.131222) 07:23:34.668031 run osmo-nitb_10.42.42.2(pid=7010): stderr: | (launched: 2022-12-09_07:23:34.179867) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:23:34.814983 run osmo-nitb_10.42.42.2(pid=7010): stdout: | (launched: 2022-12-09_07:23:34.131222) 07:23:34.956627 run osmo-nitb_10.42.42.2(pid=7010): stderr: | (launched: 2022-12-09_07:23:34.179867) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7010): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7010) [trial-2356↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7010)] 07:23:35.317158 tst osmo-nitb_10.42.42.2(pid=7010): stdout: | (launched: 2022-12-09_07:23:34.131222) 07:23:35.448462 tst osmo-nitb_10.42.42.2(pid=7010): stderr: | (launched: 2022-12-09_07:23:34.179867) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:23:35.604083 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7010): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7010) [trial-2356↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7010)] [trial-2356↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 07:23:35.613266 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:23:35.620441 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7009): Terminating (SIGTERM) 07:23:35.831388 --- ParallelTerminationStrategy: PID 7009 died... 07:23:35.852528 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7009): Terminated: ok {rc=0} 07:23:35.941226 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 07:23:37.121154 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:37.125206 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:23:37.160520 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:23:37.187993 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 07:23:37.222990 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:23:37.258033 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:23:37.285441 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 07:23:37.818699 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 07:23:37.826047 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:37.838068 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:23:37.889613 tst assert_extension.py: using LAC 19858 07:23:38.018625 tst assert_extension.py: using RAC 223 07:23:38.147766 tst assert_extension.py: using CellId 19858 07:23:38.275269 tst assert_extension.py: using BVCI 19859 07:23:38.395613 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:38.406973 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:38.418674 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:38.429896 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:38.441135 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:23:38.452251 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 07:23:38.567937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:39.043335 run create_hlr_db(pid=7014): Launched 07:23:39.162879 bus /sierra_2: Setting Powered False 07:23:40.223377 run create_hlr_db(pid=7014): Terminated: ok {rc=0} 07:23:40.672126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7016): Launched 07:23:40.999631 run osmo-hlr_10.42.42.2(pid=7017): Launched 07:23:41.126462 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:41.788803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7019): Launched 07:23:42.113587 run osmo-stp_10.42.42.5(pid=7020): Launched 07:23:42.236215 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:42.818743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7022): Launched 07:23:43.142941 run osmo-msc_10.42.42.6(pid=7023): Launched 07:23:43.323412 run osmo-stp_10.42.42.5(pid=7020): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7020)] 07:23:43.459560 run osmo-stp_10.42.42.5(pid=7020): stdout: | (launched: 2022-12-09_07:23:42.052889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:43.595852 run osmo-stp_10.42.42.5(pid=7020): stderr: | 20221209072342247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072342247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072342247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072342247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072342248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072342248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072342248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:43.731262 run osmo-stp_10.42.42.5(pid=7020): stdout: | (launched: 2022-12-09_07:23:42.052889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:43.859327 run osmo-stp_10.42.42.5(pid=7020): stderr: | 20221209072342247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072342247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072342247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072342247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072342248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072342248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072342248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:44.012348 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7020): Process ended prematurely: osmo-stp_10.42.42.5(pid=7020) [trial-2356↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7020)] [trial-2356↪ussd:trx-sysmocell5000↪assert_extension.py:17] 07:23:44.021433 tst assert_extension.py:17: Test FAILED (6.2 sec) 07:23:44.048844 run osmo-hlr_10.42.42.2(pid=7017): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7017)] 07:23:44.099579 run osmo-hlr_10.42.42.2(pid=7017): stdout: | (launched: 2022-12-09_07:23:40.939251) 07:23:44.151701 run osmo-hlr_10.42.42.2(pid=7017): stderr: | 20221209072341139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072341139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072341140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072341140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072341140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072341140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072341153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072341164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072341164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072341164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:44.224718 run osmo-msc_10.42.42.6(pid=7023): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7023)] 07:23:44.275150 run osmo-msc_10.42.42.6(pid=7023): stdout: | (launched: 2022-12-09_07:23:43.082978) 07:23:44.327268 run osmo-msc_10.42.42.6(pid=7023): stderr: | 20221209072343405 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072343405 DLGLOBAL DEBUG validating counter group 0x7fd8487aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072343405 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072343405 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072343405 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072343405 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072343407 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072343407 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072343408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072343408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:44.379801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7016): Terminating (SIGTERM) 07:23:44.422249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7019): Terminating (SIGTERM) 07:23:44.464325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7022): Terminating (SIGTERM) 07:23:44.506528 --- ParallelTerminationStrategy: PID 7016 died... 07:23:44.526349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7016): Terminated: ok {rc=0} 07:23:44.572509 --- ParallelTerminationStrategy: PID 7019 died... 07:23:44.592007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7019): Terminated: ok {rc=0} 07:23:44.637806 --- ParallelTerminationStrategy: PID 7022 died... 07:23:44.657208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7022): Terminated: ok {rc=0} 07:23:44.744360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:23:45.982414 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:45.990588 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:23:46.042187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:23:46.076124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:23:46.140720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:23:46.186508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:23:46.223887 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:23:46.784243 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:23:46.843233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:46.855714 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:23:46.928403 tst mo_mt_call.py: using LAC 19859 07:23:47.051816 tst mo_mt_call.py: using RAC 224 07:23:47.204481 tst mo_mt_call.py: using CellId 19859 07:23:47.338821 tst mo_mt_call.py: using BVCI 19860 07:23:47.453569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:47.465128 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:47.476365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:47.488579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:47.500808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:47.512837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:23:47.635318 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:23:47.759394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:48.269675 run create_hlr_db(pid=7028): Launched 07:23:48.402512 bus /sierra_2: Setting Powered False 07:23:49.467702 run create_hlr_db(pid=7028): Terminated: ok {rc=0} 07:23:49.905671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7030): Launched 07:23:50.212924 run osmo-hlr_10.42.42.2(pid=7031): Launched 07:23:50.330353 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:50.874850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7033): Launched 07:23:51.182393 run osmo-stp_10.42.42.5(pid=7034): Launched 07:23:51.300748 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:51.855878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7036): Launched 07:23:52.165631 run osmo-msc_10.42.42.6(pid=7037): Launched 07:23:52.337406 run osmo-stp_10.42.42.5(pid=7034): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7034)] 07:23:52.468503 run osmo-stp_10.42.42.5(pid=7034): stdout: | (launched: 2022-12-09_07:23:51.125227) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:52.598177 run osmo-stp_10.42.42.5(pid=7034): stderr: | 20221209072351295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072351296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072351296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072351296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072351297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072351297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072351297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:52.725504 run osmo-stp_10.42.42.5(pid=7034): stdout: | (launched: 2022-12-09_07:23:51.125227) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:52.847634 run osmo-stp_10.42.42.5(pid=7034): stderr: | 20221209072351295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072351296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072351296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072351296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072351297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072351297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072351297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:52.993396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7034): Process ended prematurely: osmo-stp_10.42.42.5(pid=7034) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7034)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:23:53.002497 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:23:53.029274 run osmo-hlr_10.42.42.2(pid=7031): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7031)] 07:23:53.077938 run osmo-hlr_10.42.42.2(pid=7031): stdout: | (launched: 2022-12-09_07:23:50.155744) 07:23:53.128190 run osmo-hlr_10.42.42.2(pid=7031): stderr: | 20221209072350334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072350334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072350334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072350334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072350334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072350334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072350346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072350355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072350355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072350355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:53.197659 run osmo-msc_10.42.42.6(pid=7037): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7037)] 07:23:53.245729 run osmo-msc_10.42.42.6(pid=7037): stdout: | (launched: 2022-12-09_07:23:52.108175) 07:23:53.295881 run osmo-msc_10.42.42.6(pid=7037): stderr: | 20221209072352380 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072352381 DLGLOBAL DEBUG validating counter group 0x7fc31552ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072352381 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072352381 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072352381 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072352381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072352383 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072352383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072352383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072352383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:53.346354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7030): Terminating (SIGTERM) 07:23:53.386363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7033): Terminating (SIGTERM) 07:23:53.426579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7036): Terminating (SIGTERM) 07:23:53.467031 --- ParallelTerminationStrategy: PID 7030 died... 07:23:53.486347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7030): Terminated: ok {rc=0} 07:23:53.531300 --- ParallelTerminationStrategy: PID 7033 died... 07:23:53.550096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7033): Terminated: ok {rc=0} 07:23:53.594835 --- ParallelTerminationStrategy: PID 7036 died... 07:23:53.613728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7036): Terminated: ok {rc=0} 07:23:53.697975 bus /sierra_3: Setting Powered False 07:23:54.795056 bus /sierra_3: Setting Powered False 07:23:55.910377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:23:57.057480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:57.069820 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:23:57.142442 tst mo_mt_call_osmux.py: using LAC 19860 07:23:57.273694 tst mo_mt_call_osmux.py: using RAC 225 07:23:57.396186 tst mo_mt_call_osmux.py: using CellId 19860 07:23:57.520835 tst mo_mt_call_osmux.py: using BVCI 19861 07:23:57.633659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:57.645306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:57.656532 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:57.668221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:57.679751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:23:57.691233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:23:57.812803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:23:57.932587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:58.411392 run create_hlr_db(pid=7039): Launched 07:23:58.528512 bus /sierra_2: Setting Powered False 07:23:59.589723 run create_hlr_db(pid=7039): Terminated: ok {rc=0} 07:24:00.018414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7041): Launched 07:24:00.329457 run osmo-hlr_10.42.42.2(pid=7042): Launched 07:24:00.447039 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:01.002408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7044): Launched 07:24:01.337641 run osmo-stp_10.42.42.5(pid=7045): Launched 07:24:01.505837 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:02.265234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7047): Launched 07:24:02.584409 run osmo-msc_10.42.42.6(pid=7048): Launched 07:24:02.757530 run osmo-stp_10.42.42.5(pid=7045): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7045)] 07:24:02.888263 run osmo-stp_10.42.42.5(pid=7045): stdout: | (launched: 2022-12-09_07:24:01.270644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:03.018123 run osmo-stp_10.42.42.5(pid=7045): stderr: | 20221209072401647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072401649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072401650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072401653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072401655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072401655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072401656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:03.146164 run osmo-stp_10.42.42.5(pid=7045): stdout: | (launched: 2022-12-09_07:24:01.270644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:03.268275 run osmo-stp_10.42.42.5(pid=7045): stderr: | 20221209072401647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072401649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072401650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072401653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072401655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072401655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072401656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:03.415004 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7045): Process ended prematurely: osmo-stp_10.42.42.5(pid=7045) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7045)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:24:03.424328 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:24:03.450995 run osmo-hlr_10.42.42.2(pid=7042): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7042)] 07:24:03.499345 run osmo-hlr_10.42.42.2(pid=7042): stdout: | (launched: 2022-12-09_07:24:00.271488) 07:24:03.549411 run osmo-hlr_10.42.42.2(pid=7042): stderr: | 20221209072400450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072400450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072400450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072400450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072400450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072400450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072400462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072400471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072400471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072400471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:03.618818 run osmo-msc_10.42.42.6(pid=7048): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7048)] 07:24:03.667028 run osmo-msc_10.42.42.6(pid=7048): stdout: | (launched: 2022-12-09_07:24:02.526679) 07:24:03.716644 run osmo-msc_10.42.42.6(pid=7048): stderr: | 20221209072402798 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072402798 DLGLOBAL DEBUG validating counter group 0x7fabf2d72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072402798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072402798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072402798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072402798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072402800 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072402800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072402801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072402801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:03.766621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7041): Terminating (SIGTERM) 07:24:03.806611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7044): Terminating (SIGTERM) 07:24:03.846791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7047): Terminating (SIGTERM) 07:24:03.887117 --- ParallelTerminationStrategy: PID 7041 died... 07:24:03.906350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7041): Terminated: ok {rc=0} 07:24:03.950745 --- ParallelTerminationStrategy: PID 7044 died... 07:24:03.969469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7044): Terminated: ok {rc=0} 07:24:04.013835 --- ParallelTerminationStrategy: PID 7047 died... 07:24:04.032390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7047): Terminated: ok {rc=0} 07:24:04.119347 bus /sierra_3: Setting Powered False 07:24:05.219256 bus /sierra_3: Setting Powered False 07:24:06.335685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:24:07.589669 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:07.596295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:24:07.631253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:24:07.658761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:24:07.711783 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:24:07.747301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:24:07.775370 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:24:08.328800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:24:08.381470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:08.393355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:24:08.466861 tst mo_mt_call.py: using LAC 19861 07:24:08.597131 tst mo_mt_call.py: using RAC 226 07:24:08.727076 tst mo_mt_call.py: using CellId 19861 07:24:08.855284 tst mo_mt_call.py: using BVCI 19862 07:24:08.974864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:08.986779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:08.998581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:09.010362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:09.022647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:09.034382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:24:09.152225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:24:09.271146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:09.749467 run create_hlr_db(pid=7053): Launched 07:24:09.868829 bus /sierra_2: Setting Powered False 07:24:10.929784 run create_hlr_db(pid=7053): Terminated: ok {rc=0} 07:24:11.359084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7055): Launched 07:24:11.669401 run osmo-hlr_10.42.42.2(pid=7056): Launched 07:24:11.784506 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:12.315416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7058): Launched 07:24:12.617512 run osmo-stp_10.42.42.5(pid=7059): Launched 07:24:12.732487 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:13.282726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7061): Launched 07:24:13.585626 run osmo-msc_10.42.42.6(pid=7062): Launched 07:24:13.754315 run osmo-stp_10.42.42.5(pid=7059): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7059)] 07:24:13.882166 run osmo-stp_10.42.42.5(pid=7059): stdout: | (launched: 2022-12-09_07:24:12.560737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:14.009690 run osmo-stp_10.42.42.5(pid=7059): stderr: | 20221209072412728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072412728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072412728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072412729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072412729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072412729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072412729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:14.134870 run osmo-stp_10.42.42.5(pid=7059): stdout: | (launched: 2022-12-09_07:24:12.560737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:14.254896 run osmo-stp_10.42.42.5(pid=7059): stderr: | 20221209072412728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072412728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072412728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072412729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072412729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072412729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072412729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:14.398799 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7059): Process ended prematurely: osmo-stp_10.42.42.5(pid=7059) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7059)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:24:14.407782 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:24:14.434904 run osmo-hlr_10.42.42.2(pid=7056): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7056)] 07:24:14.482877 run osmo-hlr_10.42.42.2(pid=7056): stdout: | (launched: 2022-12-09_07:24:11.613342) 07:24:14.532276 run osmo-hlr_10.42.42.2(pid=7056): stderr: | 20221209072411787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072411787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072411787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072411787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072411787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072411787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072411799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072411808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072411808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072411808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:14.601277 run osmo-msc_10.42.42.6(pid=7062): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7062)] 07:24:14.649298 run osmo-msc_10.42.42.6(pid=7062): stdout: | (launched: 2022-12-09_07:24:13.528876) 07:24:14.698556 run osmo-msc_10.42.42.6(pid=7062): stderr: | 20221209072413797 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072413797 DLGLOBAL DEBUG validating counter group 0x7f904197bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072413798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072413798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072413798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072413798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072413800 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072413800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072413800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072413800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:14.748356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7055): Terminating (SIGTERM) 07:24:14.787716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7058): Terminating (SIGTERM) 07:24:14.827359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7061): Terminating (SIGTERM) 07:24:14.867154 --- ParallelTerminationStrategy: PID 7055 died... 07:24:14.886113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7055): Terminated: ok {rc=0} 07:24:14.930205 --- ParallelTerminationStrategy: PID 7058 died... 07:24:14.948391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7058): Terminated: ok {rc=0} 07:24:14.992766 --- ParallelTerminationStrategy: PID 7061 died... 07:24:15.011307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7061): Terminated: ok {rc=0} 07:24:15.096890 bus /sierra_3: Setting Powered False 07:24:16.195636 bus /sierra_3: Setting Powered False 07:24:17.310133 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:24:18.458966 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:18.471389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:24:18.544794 tst mo_mt_call_osmux.py: using LAC 19862 07:24:18.672231 tst mo_mt_call_osmux.py: using RAC 227 07:24:18.793213 tst mo_mt_call_osmux.py: using CellId 19862 07:24:18.911658 tst mo_mt_call_osmux.py: using BVCI 19863 07:24:19.022208 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:19.033793 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:19.045225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:19.056631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:19.068046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:24:19.079378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:24:19.197179 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:24:19.317683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:19.820515 run create_hlr_db(pid=7064): Launched 07:24:19.951115 bus /sierra_2: Setting Powered False 07:24:21.014447 run create_hlr_db(pid=7064): Terminated: ok {rc=0} 07:24:21.465284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7066): Launched 07:24:21.788071 run osmo-hlr_10.42.42.2(pid=7067): Launched 07:24:21.910375 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:22.466117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7069): Launched 07:24:22.790910 run osmo-stp_10.42.42.5(pid=7070): Launched 07:24:22.914131 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:23.498779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7072): Launched 07:24:23.824370 run osmo-msc_10.42.42.6(pid=7073): Launched 07:24:24.004143 run osmo-stp_10.42.42.5(pid=7070): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7070)] 07:24:24.140015 run osmo-stp_10.42.42.5(pid=7070): stdout: | (launched: 2022-12-09_07:24:22.731197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:24.275920 run osmo-stp_10.42.42.5(pid=7070): stderr: | 20221209072422921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072422921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072422922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072422922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072422923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072422923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072422923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:24.410409 run osmo-stp_10.42.42.5(pid=7070): stdout: | (launched: 2022-12-09_07:24:22.731197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:24.539815 run osmo-stp_10.42.42.5(pid=7070): stderr: | 20221209072422921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072422921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072422922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072422922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072422923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072422923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072422923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:24.694132 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7070): Process ended prematurely: osmo-stp_10.42.42.5(pid=7070) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7070)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:24:24.704004 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:24:24.731700 run osmo-hlr_10.42.42.2(pid=7067): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7067)] 07:24:24.781447 run osmo-hlr_10.42.42.2(pid=7067): stdout: | (launched: 2022-12-09_07:24:21.728578) 07:24:24.833152 run osmo-hlr_10.42.42.2(pid=7067): stderr: | 20221209072421924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072421924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072421924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072421924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072421924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072421924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072421969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072421978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072421978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072421979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:24.904566 run osmo-msc_10.42.42.6(pid=7073): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7073)] 07:24:24.954250 run osmo-msc_10.42.42.6(pid=7073): stdout: | (launched: 2022-12-09_07:24:23.764280) 07:24:25.005476 run osmo-msc_10.42.42.6(pid=7073): stderr: | 20221209072424083 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072424083 DLGLOBAL DEBUG validating counter group 0x7f98c4641c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072424083 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072424083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072424084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072424084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072424086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072424086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072424086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072424086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:25.057166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7066): Terminating (SIGTERM) 07:24:25.098542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7069): Terminating (SIGTERM) 07:24:25.140110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7072): Terminating (SIGTERM) 07:24:25.181687 --- ParallelTerminationStrategy: PID 7066 died... 07:24:25.201472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7066): Terminated: ok {rc=0} 07:24:25.247027 --- ParallelTerminationStrategy: PID 7069 died... 07:24:25.266368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7069): Terminated: ok {rc=0} 07:24:25.311682 --- ParallelTerminationStrategy: PID 7072 died... 07:24:25.331048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7072): Terminated: ok {rc=0} 07:24:25.417404 bus /sierra_3: Setting Powered False 07:24:26.517414 bus /sierra_3: Setting Powered False 07:24:27.632385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:24:28.890784 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:28.898197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:24:28.933154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:24:28.960554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:24:29.015022 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:24:29.050006 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:24:29.077523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:24:29.630403 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:24:29.681837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:29.693621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:24:29.765403 tst mo_mt_call.py: using LAC 19863 07:24:29.891642 tst mo_mt_call.py: using RAC 228 07:24:30.017364 tst mo_mt_call.py: using CellId 19863 07:24:30.146263 tst mo_mt_call.py: using BVCI 19864 07:24:30.264802 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:30.276633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:30.288187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:30.299727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:30.311351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:30.323100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:24:30.439772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:24:30.555794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:31.035639 run create_hlr_db(pid=7078): Launched 07:24:31.198634 bus /sierra_2: Setting Powered False 07:24:32.268191 run create_hlr_db(pid=7078): Terminated: ok {rc=0} 07:24:32.715385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Launched 07:24:33.023201 run osmo-hlr_10.42.42.2(pid=7081): Launched 07:24:33.137042 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:33.657774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7083): Launched 07:24:33.959680 run osmo-stp_10.42.42.5(pid=7084): Launched 07:24:34.073814 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:34.618409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7086): Launched 07:24:34.921325 run osmo-msc_10.42.42.6(pid=7087): Launched 07:24:35.089834 run osmo-stp_10.42.42.5(pid=7084): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7084)] 07:24:35.217733 run osmo-stp_10.42.42.5(pid=7084): stdout: | (launched: 2022-12-09_07:24:33.903624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:35.345696 run osmo-stp_10.42.42.5(pid=7084): stderr: | 20221209072434070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072434071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072434071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072434071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072434072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072434072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072434072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:35.471114 run osmo-stp_10.42.42.5(pid=7084): stdout: | (launched: 2022-12-09_07:24:33.903624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:35.591749 run osmo-stp_10.42.42.5(pid=7084): stderr: | 20221209072434070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072434071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072434071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072434071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072434072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072434072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072434072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:35.735269 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7084): Process ended prematurely: osmo-stp_10.42.42.5(pid=7084) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7084)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:24:35.744659 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:24:35.771591 run osmo-hlr_10.42.42.2(pid=7081): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7081)] 07:24:35.819733 run osmo-hlr_10.42.42.2(pid=7081): stdout: | (launched: 2022-12-09_07:24:32.966843) 07:24:35.869170 run osmo-hlr_10.42.42.2(pid=7081): stderr: | 20221209072433139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072433139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072433139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072433139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072433139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072433139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072433151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072433160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072433161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072433161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:35.938082 run osmo-msc_10.42.42.6(pid=7087): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7087)] 07:24:35.985975 run osmo-msc_10.42.42.6(pid=7087): stdout: | (launched: 2022-12-09_07:24:34.864502) 07:24:36.035404 run osmo-msc_10.42.42.6(pid=7087): stderr: | 20221209072435135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072435136 DLGLOBAL DEBUG validating counter group 0x7fa57d215c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072435136 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072435136 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072435136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072435136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072435138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072435138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072435138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072435138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:36.085146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Terminating (SIGTERM) 07:24:36.124786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7083): Terminating (SIGTERM) 07:24:36.164393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7086): Terminating (SIGTERM) 07:24:36.204221 --- ParallelTerminationStrategy: PID 7080 died... 07:24:36.223236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Terminated: ok {rc=0} 07:24:36.268332 --- ParallelTerminationStrategy: PID 7083 died... 07:24:36.286927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7083): Terminated: ok {rc=0} 07:24:36.330897 --- ParallelTerminationStrategy: PID 7086 died... 07:24:36.349500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7086): Terminated: ok {rc=0} 07:24:36.432747 bus /sierra_3: Setting Powered False 07:24:37.528366 bus /sierra_3: Setting Powered False 07:24:38.644296 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:24:39.792836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:39.805648 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:24:39.988289 tst mo_mt_call_osmux.py: using LAC 19864 07:24:40.115537 tst mo_mt_call_osmux.py: using RAC 229 07:24:40.240492 tst mo_mt_call_osmux.py: using CellId 19864 07:24:40.365656 tst mo_mt_call_osmux.py: using BVCI 19865 07:24:40.483137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:40.495029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:40.506915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:40.518573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:40.530376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:24:40.541941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:24:40.661459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:24:40.779701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:41.250588 run create_hlr_db(pid=7089): Launched 07:24:41.373298 bus /sierra_2: Setting Powered False 07:24:42.437142 run create_hlr_db(pid=7089): Terminated: ok {rc=0} 07:24:42.887402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7091): Launched 07:24:43.210954 run osmo-hlr_10.42.42.2(pid=7092): Launched 07:24:43.333519 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:43.888269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7094): Launched 07:24:44.210567 run osmo-stp_10.42.42.5(pid=7095): Launched 07:24:44.333061 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:44.918094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7097): Launched 07:24:45.241518 run osmo-msc_10.42.42.6(pid=7098): Launched 07:24:45.421291 run osmo-stp_10.42.42.5(pid=7095): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7095)] 07:24:45.558076 run osmo-stp_10.42.42.5(pid=7095): stdout: | (launched: 2022-12-09_07:24:44.151409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:45.694277 run osmo-stp_10.42.42.5(pid=7095): stderr: | 20221209072444337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072444337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072444337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072444338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072444338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072444338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072444338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:45.830134 run osmo-stp_10.42.42.5(pid=7095): stdout: | (launched: 2022-12-09_07:24:44.151409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:45.977223 run osmo-stp_10.42.42.5(pid=7095): stderr: | 20221209072444337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072444337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072444337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072444338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072444338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072444338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072444338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:46.126661 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7095): Process ended prematurely: osmo-stp_10.42.42.5(pid=7095) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7095)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:24:46.137051 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:24:46.167562 run osmo-hlr_10.42.42.2(pid=7092): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7092)] 07:24:46.218281 run osmo-hlr_10.42.42.2(pid=7092): stdout: | (launched: 2022-12-09_07:24:43.151733) 07:24:46.270614 run osmo-hlr_10.42.42.2(pid=7092): stderr: | 20221209072443345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072443345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072443345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072443345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072443345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072443345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072443359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072443370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072443370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072443370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:46.343120 run osmo-msc_10.42.42.6(pid=7098): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7098)] 07:24:46.395036 run osmo-msc_10.42.42.6(pid=7098): stdout: | (launched: 2022-12-09_07:24:45.181872) 07:24:46.447298 run osmo-msc_10.42.42.6(pid=7098): stderr: | 20221209072445501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072445501 DLGLOBAL DEBUG validating counter group 0x7fa54b88ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072445502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072445502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072445502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072445502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072445504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072445504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072445504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072445504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:46.500126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7091): Terminating (SIGTERM) 07:24:46.543002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7094): Terminating (SIGTERM) 07:24:46.589146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7097): Terminating (SIGTERM) 07:24:46.633576 --- ParallelTerminationStrategy: PID 7091 died... 07:24:46.653887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7091): Terminated: ok {rc=0} 07:24:46.701091 --- ParallelTerminationStrategy: PID 7094 died... 07:24:46.721302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7094): Terminated: ok {rc=0} 07:24:46.768183 --- ParallelTerminationStrategy: PID 7097 died... 07:24:46.788293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7097): Terminated: ok {rc=0} 07:24:46.878594 bus /sierra_3: Setting Powered False 07:24:47.978609 bus /sierra_3: Setting Powered False 07:24:49.093341 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:24:50.349595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:50.356582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:24:50.391577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:24:50.419390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:24:50.473745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:24:50.508616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:24:50.536088 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:24:51.094973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:24:51.146673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:24:51.158382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:24:51.230695 tst mo_mt_call.py: using LAC 19865 07:24:51.358895 tst mo_mt_call.py: using RAC 230 07:24:51.487263 tst mo_mt_call.py: using CellId 19865 07:24:51.616214 tst mo_mt_call.py: using BVCI 19866 07:24:51.737770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:24:51.749506 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:24:51.761014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:24:51.772503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:24:51.784189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:24:51.795753 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:24:51.914797 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:24:52.033192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:52.511090 run create_hlr_db(pid=7103): Launched 07:24:52.625650 bus /sierra_2: Setting Powered False 07:24:53.685762 run create_hlr_db(pid=7103): Terminated: ok {rc=0} 07:24:54.122843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Launched 07:24:54.443520 run osmo-hlr_10.42.42.2(pid=7106): Launched 07:24:54.565782 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:55.116513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Launched 07:24:55.435112 run osmo-stp_10.42.42.5(pid=7109): Launched 07:24:55.557112 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:56.143475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7111): Launched 07:24:56.465315 run osmo-msc_10.42.42.6(pid=7112): Launched 07:24:56.644828 run osmo-stp_10.42.42.5(pid=7109): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] 07:24:56.779728 run osmo-stp_10.42.42.5(pid=7109): stdout: | (launched: 2022-12-09_07:24:55.377572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:56.915308 run osmo-stp_10.42.42.5(pid=7109): stderr: | 20221209072455566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072455566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072455566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072455567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072455567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072455567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072455567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:57.050501 run osmo-stp_10.42.42.5(pid=7109): stdout: | (launched: 2022-12-09_07:24:55.377572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:57.178864 run osmo-stp_10.42.42.5(pid=7109): stderr: | 20221209072455566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072455566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072455566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072455567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072455567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072455567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072455567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:57.332480 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7109): Process ended prematurely: osmo-stp_10.42.42.5(pid=7109) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:24:57.342443 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:24:57.370482 run osmo-hlr_10.42.42.2(pid=7106): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7106)] 07:24:57.420235 run osmo-hlr_10.42.42.2(pid=7106): stdout: | (launched: 2022-12-09_07:24:54.385851) 07:24:57.471739 run osmo-hlr_10.42.42.2(pid=7106): stderr: | 20221209072454578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072454578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072454578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072454578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072454578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072454578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072454591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072454599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072454600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072454600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:57.544075 run osmo-msc_10.42.42.6(pid=7112): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7112)] 07:24:57.593710 run osmo-msc_10.42.42.6(pid=7112): stdout: | (launched: 2022-12-09_07:24:56.406321) 07:24:57.644762 run osmo-msc_10.42.42.6(pid=7112): stderr: | 20221209072456725 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072456725 DLGLOBAL DEBUG validating counter group 0x7fa269819c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072456725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072456725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072456726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072456726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072456727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072456728 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072456728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072456728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:57.696473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Terminating (SIGTERM) 07:24:57.737681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Terminating (SIGTERM) 07:24:57.779102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7111): Terminating (SIGTERM) 07:24:57.820731 --- ParallelTerminationStrategy: PID 7105 died... 07:24:57.840624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Terminated: ok {rc=0} 07:24:57.886856 --- ParallelTerminationStrategy: PID 7108 died... 07:24:57.906343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Terminated: ok {rc=0} 07:24:57.952122 --- ParallelTerminationStrategy: PID 7111 died... 07:24:57.971613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7111): Terminated: ok {rc=0} 07:24:58.059011 bus /sierra_3: Setting Powered False 07:24:59.157494 bus /sierra_3: Setting Powered False 07:25:00.272822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:25:01.425213 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:25:01.438727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:25:01.513204 tst mo_mt_call_osmux.py: using LAC 19866 07:25:01.639505 tst mo_mt_call_osmux.py: using RAC 231 07:25:01.764412 tst mo_mt_call_osmux.py: using CellId 19866 07:25:01.887963 tst mo_mt_call_osmux.py: using BVCI 19867 07:25:02.006998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:25:02.019174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:25:02.031331 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:25:02.043624 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:25:02.055903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:25:02.068095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:25:02.197941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:25:02.317507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:02.782134 run create_hlr_db(pid=7117): Launched 07:25:02.896191 bus /sierra_2: Setting Powered False 07:25:03.956359 run create_hlr_db(pid=7117): Terminated: ok {rc=0} 07:25:04.374158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Launched 07:25:04.673646 run osmo-hlr_10.42.42.2(pid=7120): Launched 07:25:04.787844 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:05.317457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Launched 07:25:05.617738 run osmo-stp_10.42.42.5(pid=7123): Launched 07:25:05.731909 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:06.274188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7125): Launched 07:25:06.573929 run osmo-msc_10.42.42.6(pid=7126): Launched 07:25:06.741548 run osmo-stp_10.42.42.5(pid=7123): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] 07:25:06.869241 run osmo-stp_10.42.42.5(pid=7123): stdout: | (launched: 2022-12-09_07:25:05.562650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:06.995828 run osmo-stp_10.42.42.5(pid=7123): stderr: | 20221209072505728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072505728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072505729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072505729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072505730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072505730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072505730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:07.120725 run osmo-stp_10.42.42.5(pid=7123): stdout: | (launched: 2022-12-09_07:25:05.562650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:07.239934 run osmo-stp_10.42.42.5(pid=7123): stderr: | 20221209072505728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072505728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072505729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072505729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072505730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072505730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072505730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:07.382442 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7123): Process ended prematurely: osmo-stp_10.42.42.5(pid=7123) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:25:07.391385 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:25:07.417330 run osmo-hlr_10.42.42.2(pid=7120): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7120)] 07:25:07.464266 run osmo-hlr_10.42.42.2(pid=7120): stdout: | (launched: 2022-12-09_07:25:04.618262) 07:25:07.514360 run osmo-hlr_10.42.42.2(pid=7120): stderr: | 20221209072504791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072504791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072504791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072504791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072504791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072504791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072504803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072504812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072504812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072504812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:07.582630 run osmo-msc_10.42.42.6(pid=7126): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7126)] 07:25:07.629890 run osmo-msc_10.42.42.6(pid=7126): stdout: | (launched: 2022-12-09_07:25:06.518543) 07:25:07.678659 run osmo-msc_10.42.42.6(pid=7126): stderr: | 20221209072506787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072506787 DLGLOBAL DEBUG validating counter group 0x7fa163a27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072506787 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072506787 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072506787 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072506788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072506790 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072506790 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072506791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072506791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:07.727904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Terminating (SIGTERM) 07:25:07.766691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Terminating (SIGTERM) 07:25:07.805866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7125): Terminating (SIGTERM) 07:25:07.845229 --- ParallelTerminationStrategy: PID 7119 died... 07:25:07.864327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Terminated: ok {rc=0} 07:25:07.907756 --- ParallelTerminationStrategy: PID 7122 died... 07:25:07.926451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Terminated: ok {rc=0} 07:25:07.970415 --- ParallelTerminationStrategy: PID 7125 died... 07:25:07.988708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7125): Terminated: ok {rc=0} 07:25:08.074313 bus /sierra_3: Setting Powered False 07:25:09.172322 bus /sierra_3: Setting Powered False 07:25:10.284565 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:25:11.535569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:11.543421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:25:11.577502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:25:11.604114 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:25:11.656547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:25:11.690601 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:25:11.717551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:25:12.270714 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:25:12.318838 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:12.330309 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:25:12.400717 tst mo_mt_call.py: using LAC 19867 07:25:12.518415 tst mo_mt_call.py: using RAC 232 07:25:12.638247 tst mo_mt_call.py: using CellId 19867 07:25:12.757963 tst mo_mt_call.py: using BVCI 19868 07:25:12.866124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:12.877644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:12.888836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:12.900167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:12.911508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:12.922698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:25:13.044366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:25:13.162849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:13.627241 run create_hlr_db(pid=7131): Launched 07:25:13.741429 bus /sierra_2: Setting Powered False 07:25:14.801376 run create_hlr_db(pid=7131): Terminated: ok {rc=0} 07:25:15.220370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7133): Launched 07:25:15.520544 run osmo-hlr_10.42.42.2(pid=7134): Launched 07:25:15.635165 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:16.174056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7136): Launched 07:25:16.493562 run osmo-stp_10.42.42.5(pid=7137): Launched 07:25:16.763791 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:17.395817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7139): Launched 07:25:17.718157 run osmo-msc_10.42.42.6(pid=7140): Launched 07:25:17.896192 run osmo-stp_10.42.42.5(pid=7137): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7137)] 07:25:18.031075 run osmo-stp_10.42.42.5(pid=7137): stdout: | (launched: 2022-12-09_07:25:16.434773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:18.166057 run osmo-stp_10.42.42.5(pid=7137): stderr: | 20221209072516640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072516640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072516640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072516640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072516642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072516642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072516642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:18.300332 run osmo-stp_10.42.42.5(pid=7137): stdout: | (launched: 2022-12-09_07:25:16.434773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:18.428865 run osmo-stp_10.42.42.5(pid=7137): stderr: | 20221209072516640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072516640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072516640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072516640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072516642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072516642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072516642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:18.582850 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7137): Process ended prematurely: osmo-stp_10.42.42.5(pid=7137) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7137)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:25:18.592486 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:25:18.620075 run osmo-hlr_10.42.42.2(pid=7134): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7134)] 07:25:18.669391 run osmo-hlr_10.42.42.2(pid=7134): stdout: | (launched: 2022-12-09_07:25:15.465463) 07:25:18.720392 run osmo-hlr_10.42.42.2(pid=7134): stderr: | 20221209072515639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072515639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072515639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072515639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072515639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072515639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072515651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072515659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072515660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072515660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:18.791839 run osmo-msc_10.42.42.6(pid=7140): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7140)] 07:25:18.841343 run osmo-msc_10.42.42.6(pid=7140): stdout: | (launched: 2022-12-09_07:25:17.659898) 07:25:18.892406 run osmo-msc_10.42.42.6(pid=7140): stderr: | 20221209072517978 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072517978 DLGLOBAL DEBUG validating counter group 0x7f4ad779ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072517979 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072517979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072517979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072517979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072517981 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072517981 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072517981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072517981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:18.943682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7133): Terminating (SIGTERM) 07:25:18.984696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7136): Terminating (SIGTERM) 07:25:19.025938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7139): Terminating (SIGTERM) 07:25:19.067351 --- ParallelTerminationStrategy: PID 7133 died... 07:25:19.087201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7133): Terminated: ok {rc=0} 07:25:19.133149 --- ParallelTerminationStrategy: PID 7136 died... 07:25:19.152579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7136): Terminated: ok {rc=0} 07:25:19.198167 --- ParallelTerminationStrategy: PID 7139 died... 07:25:19.217593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7139): Terminated: ok {rc=0} 07:25:19.304412 bus /sierra_3: Setting Powered False 07:25:20.402436 bus /sierra_3: Setting Powered False 07:25:21.517201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:25:22.659169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:22.671263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:25:22.741911 tst mo_mt_call_osmux.py: using LAC 19868 07:25:22.862941 tst mo_mt_call_osmux.py: using RAC 233 07:25:22.990658 tst mo_mt_call_osmux.py: using CellId 19868 07:25:23.118271 tst mo_mt_call_osmux.py: using BVCI 19869 07:25:23.236763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:23.248621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:23.260244 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:23.271814 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:23.283479 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:25:23.295087 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:25:23.413333 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:25:23.534370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:24.033971 run create_hlr_db(pid=7142): Launched 07:25:24.166135 bus /sierra_2: Setting Powered False 07:25:25.229144 run create_hlr_db(pid=7142): Terminated: ok {rc=0} 07:25:25.657706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Launched 07:25:25.958832 run osmo-hlr_10.42.42.2(pid=7145): Launched 07:25:26.072050 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:26.599702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Launched 07:25:26.898279 run osmo-stp_10.42.42.5(pid=7148): Launched 07:25:27.013806 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:27.555962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7150): Launched 07:25:27.856435 run osmo-msc_10.42.42.6(pid=7151): Launched 07:25:28.023936 run osmo-stp_10.42.42.5(pid=7148): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] 07:25:28.152108 run osmo-stp_10.42.42.5(pid=7148): stdout: | (launched: 2022-12-09_07:25:26.843434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:28.279815 run osmo-stp_10.42.42.5(pid=7148): stderr: | 20221209072527010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072527010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072527010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072527011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072527011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072527011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072527011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:28.405110 run osmo-stp_10.42.42.5(pid=7148): stdout: | (launched: 2022-12-09_07:25:26.843434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:28.525571 run osmo-stp_10.42.42.5(pid=7148): stderr: | 20221209072527010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072527010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072527010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072527011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072527011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072527011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072527011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:28.669432 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7148): Process ended prematurely: osmo-stp_10.42.42.5(pid=7148) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:25:28.678870 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:25:28.705078 run osmo-hlr_10.42.42.2(pid=7145): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7145)] 07:25:28.752339 run osmo-hlr_10.42.42.2(pid=7145): stdout: | (launched: 2022-12-09_07:25:25.903819) 07:25:28.801914 run osmo-hlr_10.42.42.2(pid=7145): stderr: | 20221209072526077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072526077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072526077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072526078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072526078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072526078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072526090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072526099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072526099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072526099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:28.870967 run osmo-msc_10.42.42.6(pid=7151): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7151)] 07:25:28.918551 run osmo-msc_10.42.42.6(pid=7151): stdout: | (launched: 2022-12-09_07:25:27.801059) 07:25:28.967317 run osmo-msc_10.42.42.6(pid=7151): stderr: | 20221209072528070 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072528070 DLGLOBAL DEBUG validating counter group 0x7f846b3d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072528070 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072528070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072528071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072528071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072528073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072528073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072528073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072528073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:29.017095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Terminating (SIGTERM) 07:25:29.056484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Terminating (SIGTERM) 07:25:29.096226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7150): Terminating (SIGTERM) 07:25:29.136173 --- ParallelTerminationStrategy: PID 7144 died... 07:25:29.155158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Terminated: ok {rc=0} 07:25:29.199306 --- ParallelTerminationStrategy: PID 7147 died... 07:25:29.218102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Terminated: ok {rc=0} 07:25:29.261614 --- ParallelTerminationStrategy: PID 7150 died... 07:25:29.280396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7150): Terminated: ok {rc=0} 07:25:29.366480 bus /sierra_3: Setting Powered False 07:25:30.463826 bus /sierra_3: Setting Powered False 07:25:31.581397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:25:32.834806 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:32.841461 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:25:32.875051 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:25:32.902737 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:25:32.954467 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:25:32.987906 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:25:33.014701 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:25:33.568327 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:25:33.616385 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:33.628235 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:25:33.700524 tst mo_mt_call.py: using LAC 19869 07:25:33.819481 tst mo_mt_call.py: using RAC 234 07:25:33.938585 tst mo_mt_call.py: using CellId 19869 07:25:34.057372 tst mo_mt_call.py: using BVCI 19870 07:25:34.168415 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:34.179843 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:34.191060 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:34.202166 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:34.213373 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:34.224328 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:25:34.341760 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:25:34.462332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:34.960538 run create_hlr_db(pid=7156): Launched 07:25:35.090678 bus /sierra_2: Setting Powered False 07:25:36.154247 run create_hlr_db(pid=7156): Terminated: ok {rc=0} 07:25:36.581500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Launched 07:25:36.879503 run osmo-hlr_10.42.42.2(pid=7159): Launched 07:25:36.993204 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:37.518003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Launched 07:25:37.816627 run osmo-stp_10.42.42.5(pid=7162): Launched 07:25:37.930141 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:38.470308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7164): Launched 07:25:38.770795 run osmo-msc_10.42.42.6(pid=7165): Launched 07:25:38.938724 run osmo-stp_10.42.42.5(pid=7162): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] 07:25:39.066268 run osmo-stp_10.42.42.5(pid=7162): stdout: | (launched: 2022-12-09_07:25:37.761881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:39.193177 run osmo-stp_10.42.42.5(pid=7162): stderr: | 20221209072537928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072537928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072537928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072537929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072537929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072537930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072537930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:39.318709 run osmo-stp_10.42.42.5(pid=7162): stdout: | (launched: 2022-12-09_07:25:37.761881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:39.438941 run osmo-stp_10.42.42.5(pid=7162): stderr: | 20221209072537928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072537928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072537928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072537929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072537929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072537930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072537930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:39.582870 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7162): Process ended prematurely: osmo-stp_10.42.42.5(pid=7162) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:25:39.591987 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:25:39.617990 run osmo-hlr_10.42.42.2(pid=7159): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7159)] 07:25:39.665940 run osmo-hlr_10.42.42.2(pid=7159): stdout: | (launched: 2022-12-09_07:25:36.825267) 07:25:39.715174 run osmo-hlr_10.42.42.2(pid=7159): stderr: | 20221209072536996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072536996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072536996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072536996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072536996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072536996 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072537009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072537018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072537018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072537018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:39.783605 run osmo-msc_10.42.42.6(pid=7165): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7165)] 07:25:39.831048 run osmo-msc_10.42.42.6(pid=7165): stdout: | (launched: 2022-12-09_07:25:38.715419) 07:25:39.880119 run osmo-msc_10.42.42.6(pid=7165): stderr: | 20221209072538984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072538984 DLGLOBAL DEBUG validating counter group 0x7f8644e8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072538984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072538984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072538984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072538985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072538986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072538987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072538987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072538987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:39.929402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Terminating (SIGTERM) 07:25:39.969066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Terminating (SIGTERM) 07:25:40.008588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7164): Terminating (SIGTERM) 07:25:40.048302 --- ParallelTerminationStrategy: PID 7158 died... 07:25:40.067041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Terminated: ok {rc=0} 07:25:40.111218 --- ParallelTerminationStrategy: PID 7161 died... 07:25:40.129677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Terminated: ok {rc=0} 07:25:40.173430 --- ParallelTerminationStrategy: PID 7164 died... 07:25:40.191989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7164): Terminated: ok {rc=0} 07:25:40.274884 bus /sierra_3: Setting Powered False 07:25:41.371914 bus /sierra_3: Setting Powered False 07:25:42.488283 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:25:43.632797 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:43.645134 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:25:43.716819 tst mo_mt_call_osmux.py: using LAC 19870 07:25:43.835702 tst mo_mt_call_osmux.py: using RAC 235 07:25:43.955039 tst mo_mt_call_osmux.py: using CellId 19870 07:25:44.082830 tst mo_mt_call_osmux.py: using BVCI 19871 07:25:44.200802 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:44.212900 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:44.224829 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:44.236755 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:44.248725 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:25:44.260434 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:25:44.382395 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:25:44.497709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:44.962145 run create_hlr_db(pid=7167): Launched 07:25:45.078260 bus /sierra_2: Setting Powered False 07:25:46.142076 run create_hlr_db(pid=7167): Terminated: ok {rc=0} 07:25:46.601704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7169): Launched 07:25:46.941366 run osmo-hlr_10.42.42.2(pid=7170): Launched 07:25:47.175332 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:47.729433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7172): Launched 07:25:48.048408 run osmo-stp_10.42.42.5(pid=7173): Launched 07:25:48.169583 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:48.749311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7175): Launched 07:25:49.070098 run osmo-msc_10.42.42.6(pid=7176): Launched 07:25:49.247373 run osmo-stp_10.42.42.5(pid=7173): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7173)] 07:25:49.383068 run osmo-stp_10.42.42.5(pid=7173): stdout: | (launched: 2022-12-09_07:25:47.990361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:49.519469 run osmo-stp_10.42.42.5(pid=7173): stderr: | 20221209072548177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072548177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072548178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072548178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072548179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072548179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072548179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:49.653578 run osmo-stp_10.42.42.5(pid=7173): stdout: | (launched: 2022-12-09_07:25:47.990361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:49.782080 run osmo-stp_10.42.42.5(pid=7173): stderr: | 20221209072548177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072548177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072548178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072548178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072548179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072548179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072548179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:49.935545 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7173): Process ended prematurely: osmo-stp_10.42.42.5(pid=7173) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7173)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:25:49.945378 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:25:49.972807 run osmo-hlr_10.42.42.2(pid=7170): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7170)] 07:25:50.022070 run osmo-hlr_10.42.42.2(pid=7170): stdout: | (launched: 2022-12-09_07:25:46.882479) 07:25:50.072910 run osmo-hlr_10.42.42.2(pid=7170): stderr: | 20221209072547125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072547125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072547125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072547125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072547125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072547125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072547143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072547154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072547155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072547155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:50.143907 run osmo-msc_10.42.42.6(pid=7176): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7176)] 07:25:50.193241 run osmo-msc_10.42.42.6(pid=7176): stdout: | (launched: 2022-12-09_07:25:49.011465) 07:25:50.243976 run osmo-msc_10.42.42.6(pid=7176): stderr: | 20221209072549329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072549329 DLGLOBAL DEBUG validating counter group 0x7f16e2f88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072549329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072549330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072549330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072549330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072549331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072549332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072549332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072549332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:50.295160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7169): Terminating (SIGTERM) 07:25:50.336051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7172): Terminating (SIGTERM) 07:25:50.377177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7175): Terminating (SIGTERM) 07:25:50.418391 --- ParallelTerminationStrategy: PID 7169 died... 07:25:50.438141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7169): Terminated: ok {rc=0} 07:25:50.484047 --- ParallelTerminationStrategy: PID 7172 died... 07:25:50.503438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7172): Terminated: ok {rc=0} 07:25:50.549058 --- ParallelTerminationStrategy: PID 7175 died... 07:25:50.568417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7175): Terminated: ok {rc=0} 07:25:50.654815 bus /sierra_3: Setting Powered False 07:25:51.749957 bus /sierra_3: Setting Powered False 07:25:52.863634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:25:54.122724 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:54.128749 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:25:54.163911 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:25:54.191705 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:25:54.245296 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:25:54.280361 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:25:54.307963 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:25:54.861986 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:25:54.912035 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:25:54.923547 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:25:54.995331 tst mo_mt_call.py: using LAC 19871 07:25:55.116064 tst mo_mt_call.py: using RAC 236 07:25:55.243823 tst mo_mt_call.py: using CellId 19871 07:25:55.371709 tst mo_mt_call.py: using BVCI 19872 07:25:55.483619 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:25:55.494912 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:25:55.506072 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:25:55.517112 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:25:55.528223 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:25:55.539316 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:25:55.660289 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:25:55.778846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:56.243997 run create_hlr_db(pid=7181): Launched 07:25:56.358278 bus /sierra_2: Setting Powered False 07:25:57.417469 run create_hlr_db(pid=7181): Terminated: ok {rc=0} 07:25:57.858270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7183): Launched 07:25:58.181659 run osmo-hlr_10.42.42.2(pid=7184): Launched 07:25:58.305549 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:58.862722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7186): Launched 07:25:59.184504 run osmo-stp_10.42.42.5(pid=7187): Launched 07:25:59.306911 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:59.891586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7189): Launched 07:26:00.213969 run osmo-msc_10.42.42.6(pid=7190): Launched 07:26:00.395473 run osmo-stp_10.42.42.5(pid=7187): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7187)] 07:26:00.531739 run osmo-stp_10.42.42.5(pid=7187): stdout: | (launched: 2022-12-09_07:25:59.125764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:00.668140 run osmo-stp_10.42.42.5(pid=7187): stderr: | 20221209072559313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072559313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072559313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072559313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072559314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072559314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072559314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:00.802640 run osmo-stp_10.42.42.5(pid=7187): stdout: | (launched: 2022-12-09_07:25:59.125764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:00.941307 run osmo-stp_10.42.42.5(pid=7187): stderr: | 20221209072559313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072559313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072559313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072559313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072559314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072559314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072559314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:01.097316 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7187): Process ended prematurely: osmo-stp_10.42.42.5(pid=7187) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7187)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:26:01.107454 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:26:01.135562 run osmo-hlr_10.42.42.2(pid=7184): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7184)] 07:26:01.186634 run osmo-hlr_10.42.42.2(pid=7184): stdout: | (launched: 2022-12-09_07:25:58.123253) 07:26:01.239344 run osmo-hlr_10.42.42.2(pid=7184): stderr: | 20221209072558316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072558317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072558317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072558317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072558317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072558317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072558329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072558338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072558338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072558338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:01.312405 run osmo-msc_10.42.42.6(pid=7190): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7190)] 07:26:01.363747 run osmo-msc_10.42.42.6(pid=7190): stdout: | (launched: 2022-12-09_07:26:00.155289) 07:26:01.416210 run osmo-msc_10.42.42.6(pid=7190): stderr: | 20221209072600473 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072600473 DLGLOBAL DEBUG validating counter group 0x7f6aff070c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072600473 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072600473 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072600473 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072600474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072600475 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072600476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072600476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072600476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:01.469057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7183): Terminating (SIGTERM) 07:26:01.512077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7186): Terminating (SIGTERM) 07:26:01.557030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7189): Terminating (SIGTERM) 07:26:01.600643 --- ParallelTerminationStrategy: PID 7183 died... 07:26:01.622348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7183): Terminated: ok {rc=0} 07:26:01.671093 --- ParallelTerminationStrategy: PID 7186 died... 07:26:01.691002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7186): Terminated: ok {rc=0} 07:26:01.737530 --- ParallelTerminationStrategy: PID 7189 died... 07:26:01.757554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7189): Terminated: ok {rc=0} 07:26:01.847539 bus /sierra_3: Setting Powered False 07:26:02.946358 bus /sierra_3: Setting Powered False 07:26:04.060787 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:26:05.205056 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:26:05.216938 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:26:05.287190 tst mo_mt_call_osmux.py: using LAC 19872 07:26:05.403744 tst mo_mt_call_osmux.py: using RAC 237 07:26:05.521363 tst mo_mt_call_osmux.py: using CellId 19872 07:26:05.638233 tst mo_mt_call_osmux.py: using BVCI 19873 07:26:05.747399 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:26:05.758704 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:26:05.769667 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:26:05.780567 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:26:05.791565 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:26:05.802607 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:26:05.925745 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:26:06.046719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:06.513175 run create_hlr_db(pid=7192): Launched 07:26:06.627879 bus /sierra_2: Setting Powered False 07:26:07.687503 run create_hlr_db(pid=7192): Terminated: ok {rc=0} 07:26:08.107047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7194): Launched 07:26:08.406816 run osmo-hlr_10.42.42.2(pid=7195): Launched 07:26:08.521111 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:09.035625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7197): Launched 07:26:09.336237 run osmo-stp_10.42.42.5(pid=7198): Launched 07:26:09.451298 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:09.995900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7200): Launched 07:26:10.297310 run osmo-msc_10.42.42.6(pid=7201): Launched 07:26:10.464802 run osmo-stp_10.42.42.5(pid=7198): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7198)] 07:26:10.592456 run osmo-stp_10.42.42.5(pid=7198): stdout: | (launched: 2022-12-09_07:26:09.280635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:10.721136 run osmo-stp_10.42.42.5(pid=7198): stderr: | 20221209072609448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072609448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072609448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072609449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072609449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072609449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072609449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:10.846474 run osmo-stp_10.42.42.5(pid=7198): stdout: | (launched: 2022-12-09_07:26:09.280635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:10.966122 run osmo-stp_10.42.42.5(pid=7198): stderr: | 20221209072609448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072609448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072609448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072609449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072609449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072609449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072609449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:11.110102 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7198): Process ended prematurely: osmo-stp_10.42.42.5(pid=7198) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7198)] [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:26:11.119557 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:26:11.145800 run osmo-hlr_10.42.42.2(pid=7195): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7195)] 07:26:11.193160 run osmo-hlr_10.42.42.2(pid=7195): stdout: | (launched: 2022-12-09_07:26:08.351776) 07:26:11.242197 run osmo-hlr_10.42.42.2(pid=7195): stderr: | 20221209072608524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072608524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072608524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072608524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072608524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072608524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072608535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072608544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072608544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072608544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:11.310815 run osmo-msc_10.42.42.6(pid=7201): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7201)] 07:26:11.358476 run osmo-msc_10.42.42.6(pid=7201): stdout: | (launched: 2022-12-09_07:26:10.241542) 07:26:11.407443 run osmo-msc_10.42.42.6(pid=7201): stderr: | 20221209072610509 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072610509 DLGLOBAL DEBUG validating counter group 0x7ff48316ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072610509 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072610509 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072610510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072610510 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072610511 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072610512 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072610512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072610512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:11.457326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7194): Terminating (SIGTERM) 07:26:11.496886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7197): Terminating (SIGTERM) 07:26:11.536016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7200): Terminating (SIGTERM) 07:26:11.576021 --- ParallelTerminationStrategy: PID 7194 died... 07:26:11.595006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7194): Terminated: ok {rc=0} 07:26:11.639336 --- ParallelTerminationStrategy: PID 7197 died... 07:26:11.657883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7197): Terminated: ok {rc=0} 07:26:11.701967 --- ParallelTerminationStrategy: PID 7200 died... 07:26:11.720639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7200): Terminated: ok {rc=0} 07:26:11.805421 bus /sierra_3: Setting Powered False 07:26:12.903912 bus /sierra_3: Setting Powered False 07:26:14.018007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 07:26:15.265045 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:26:15.269311 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:26:15.302901 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:26:15.329496 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 07:26:15.415003 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:26:15.448786 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:26:15.475431 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 07:26:16.075817 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 07:26:16.086381 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:16.105740 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:26:16.159947 tst emergency_mo_mt_call.py: using LAC 19873 07:26:16.291120 tst emergency_mo_mt_call.py: using RAC 238 07:26:16.416479 tst emergency_mo_mt_call.py: using CellId 19873 07:26:16.543970 tst emergency_mo_mt_call.py: using BVCI 19874 07:26:16.663388 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:16.675795 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:16.688030 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:16.700324 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:16.712189 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:16.724060 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:16.874326 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:16.997056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:17.459151 run create_hlr_db(pid=7206): Launched 07:26:17.571109 bus /sierra_2: Setting Powered False 07:26:18.630003 run create_hlr_db(pid=7206): Terminated: ok {rc=0} 07:26:19.040609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7208): Launched 07:26:19.334456 run osmo-hlr_10.42.42.2(pid=7209): Launched 07:26:19.447789 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:19.955143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7211): Launched 07:26:20.249450 run osmo-stp_10.42.42.5(pid=7212): Launched 07:26:20.370897 tst emergency_mo_mt_call.py: using MSISDN 7088 07:26:20.520521 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:21.049934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7214): Launched 07:26:21.345047 run osmo-msc_10.42.42.6(pid=7215): Launched 07:26:21.510118 run osmo-stp_10.42.42.5(pid=7212): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7212)] 07:26:21.636585 run osmo-stp_10.42.42.5(pid=7212): stdout: | (launched: 2022-12-09_07:26:20.195132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:21.762750 run osmo-stp_10.42.42.5(pid=7212): stderr: | 20221209072620362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072620362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072620363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072620364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072620365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072620365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072620365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:21.886094 run osmo-stp_10.42.42.5(pid=7212): stdout: | (launched: 2022-12-09_07:26:20.195132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:22.003366 run osmo-stp_10.42.42.5(pid=7212): stderr: | 20221209072620362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072620362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072620363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072620364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072620365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072620365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072620365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:22.144128 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7212): Process ended prematurely: osmo-stp_10.42.42.5(pid=7212) [trial-2356↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7212)] [trial-2356↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 07:26:22.152540 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 07:26:22.178621 run osmo-hlr_10.42.42.2(pid=7209): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7209)] 07:26:22.226684 run osmo-hlr_10.42.42.2(pid=7209): stdout: | (launched: 2022-12-09_07:26:19.280339) 07:26:22.276234 run osmo-hlr_10.42.42.2(pid=7209): stderr: | 20221209072619451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072619451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072619451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072619451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072619451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072619451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072619463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072619471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072619471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072619472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:22.345432 run osmo-msc_10.42.42.6(pid=7215): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7215)] 07:26:22.393371 run osmo-msc_10.42.42.6(pid=7215): stdout: | (launched: 2022-12-09_07:26:21.289969) 07:26:22.442968 run osmo-msc_10.42.42.6(pid=7215): stderr: | 20221209072621559 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072621560 DLGLOBAL DEBUG validating counter group 0x7fb4047c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072621560 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072621560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072621560 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072621561 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072621563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072621563 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072621563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072621563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:22.492826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7208): Terminating (SIGTERM) 07:26:22.532635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7211): Terminating (SIGTERM) 07:26:22.572906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7214): Terminating (SIGTERM) 07:26:22.613123 --- ParallelTerminationStrategy: PID 7208 died... 07:26:22.632128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7208): Terminated: ok {rc=0} 07:26:22.676628 --- ParallelTerminationStrategy: PID 7211 died... 07:26:22.695258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7211): Terminated: ok {rc=0} 07:26:22.739316 --- ParallelTerminationStrategy: PID 7214 died... 07:26:22.757801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7214): Terminated: ok {rc=0} 07:26:22.841867 bus /sierra_3: Setting Powered False 07:26:23.940451 bus /sierra_3: Setting Powered False 07:26:25.057154 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 07:26:26.144533 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:26.156180 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:26:26.209419 tst emergency_preemptive_call.py: using LAC 19874 07:26:26.327269 tst emergency_preemptive_call.py: using RAC 239 07:26:26.444773 tst emergency_preemptive_call.py: using CellId 19874 07:26:26.561392 tst emergency_preemptive_call.py: using BVCI 19875 07:26:26.671449 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:26.682450 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:26.693115 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:26.704501 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:26.715953 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:26:26.727249 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:26.843100 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:26.957023 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:27.071455 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:27.185117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:27.681985 run create_hlr_db(pid=7217): Launched 07:26:27.811643 bus /sierra_2: Setting Powered False 07:26:28.874177 run create_hlr_db(pid=7217): Terminated: ok {rc=0} 07:26:29.315802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7219): Launched 07:26:29.631957 run osmo-hlr_10.42.42.2(pid=7220): Launched 07:26:29.753097 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:30.302347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7222): Launched 07:26:30.621071 run osmo-stp_10.42.42.5(pid=7223): Launched 07:26:30.763767 tst emergency_preemptive_call.py: using MSISDN 7089 07:26:30.985383 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:31.596364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7225): Launched 07:26:31.912456 run osmo-msc_10.42.42.6(pid=7226): Launched 07:26:32.251937 run osmo-stp_10.42.42.5(pid=7223): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7223)] 07:26:32.453849 run osmo-stp_10.42.42.5(pid=7223): stdout: | (launched: 2022-12-09_07:26:30.561385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:32.580294 run osmo-stp_10.42.42.5(pid=7223): stderr: | 20221209072630750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072630750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072630751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072630751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072630751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072630752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072630752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:32.704222 run osmo-stp_10.42.42.5(pid=7223): stdout: | (launched: 2022-12-09_07:26:30.561385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:32.822157 run osmo-stp_10.42.42.5(pid=7223): stderr: | 20221209072630750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072630750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072630751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072630751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072630751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072630752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072630752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:32.962924 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7223): Process ended prematurely: osmo-stp_10.42.42.5(pid=7223) [trial-2356↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7223)] [trial-2356↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 07:26:32.971701 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 07:26:32.998285 run osmo-hlr_10.42.42.2(pid=7220): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7220)] 07:26:33.046617 run osmo-hlr_10.42.42.2(pid=7220): stdout: | (launched: 2022-12-09_07:26:29.574222) 07:26:33.096677 run osmo-hlr_10.42.42.2(pid=7220): stderr: | 20221209072629769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072629769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072629769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072629769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072629769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072629770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072629782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072629790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072629790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072629790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:33.166496 run osmo-msc_10.42.42.6(pid=7226): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7226)] 07:26:33.214769 run osmo-msc_10.42.42.6(pid=7226): stdout: | (launched: 2022-12-09_07:26:31.855558) 07:26:33.264756 run osmo-msc_10.42.42.6(pid=7226): stderr: | 20221209072632325 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209072632325 DLGLOBAL DEBUG validating counter group 0x7f2e2e1d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209072632326 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209072632326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209072632326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209072632326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209072632328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209072632328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209072632328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209072632328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:33.315136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7219): Terminating (SIGTERM) 07:26:33.355244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7222): Terminating (SIGTERM) 07:26:33.395261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7225): Terminating (SIGTERM) 07:26:33.435257 --- ParallelTerminationStrategy: PID 7219 died... 07:26:33.454276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7219): Terminated: ok {rc=0} 07:26:33.498590 --- ParallelTerminationStrategy: PID 7222 died... 07:26:33.517082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7222): Terminated: ok {rc=0} 07:26:33.561346 --- ParallelTerminationStrategy: PID 7225 died... 07:26:33.579978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7225): Terminated: ok {rc=0} 07:26:33.665743 bus /sierra_9: Setting Powered False 07:26:34.764663 bus /sierra_9: Setting Powered False 07:26:35.880868 bus /sierra_8: Setting Powered False 07:26:36.978654 bus /sierra_8: Setting Powered False 07:26:38.093038 bus /sierra_3: Setting Powered False 07:26:39.191224 bus /sierra_3: Setting Powered False 07:26:40.308063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 07:26:41.597018 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:26:41.601832 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:26:41.637261 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 07:26:41.677301 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 07:26:41.766872 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:26:41.802344 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 07:26:41.842375 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 07:26:42.432881 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 07:26:42.487309 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:42.498756 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:26:42.550547 tst cs_paging_gprs_active.py: using LAC 19875 07:26:42.679397 tst cs_paging_gprs_active.py: using RAC 240 07:26:42.799299 tst cs_paging_gprs_active.py: using CellId 19875 07:26:42.919199 tst cs_paging_gprs_active.py: using BVCI 19876 07:26:43.029987 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.040715 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.051489 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.062402 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.073356 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.084024 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.094937 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.105739 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:43.116697 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:43.232345 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:43.347713 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:26:43.550380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:43.853318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7231): Launched 07:26:44.115637 run iperf3-srv_10.42.42.10(pid=7232): Launched 07:26:44.228371 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:26:44.429512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:44.730934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7233): Launched 07:26:44.992438 run iperf3-srv_10.42.42.10(pid=7234): Launched 07:26:45.104788 tst cs_paging_gprs_active.py:38: start network... 07:26:45.306151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:45.773776 run create_hlr_db(pid=7235): Launched 07:26:45.890663 bus /sierra_2: Setting Powered False 07:26:46.964201 run create_hlr_db(pid=7235): Terminated: ok {rc=0} 07:26:47.462055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7237): Launched 07:26:47.763482 run osmo-hlr_10.42.42.2(pid=7238): Launched 07:26:47.877985 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:48.407382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7240): Launched 07:26:48.710180 run osmo-stp_10.42.42.5(pid=7241): Launched 07:26:48.827402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:26:49.347861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7243): Launched 07:26:49.463616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:26:49.719201 run patchelf(pid=7244): Launched 07:26:49.887394 run osmo-stp_10.42.42.5(pid=7241): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7241)] 07:26:50.014796 run osmo-stp_10.42.42.5(pid=7241): stdout: | (launched: 2022-12-09_07:26:48.654504) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:50.143917 run osmo-stp_10.42.42.5(pid=7241): stderr: | 20221209072648822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072648822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072648822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072648822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072648823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072648823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072648823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:50.273436 run osmo-stp_10.42.42.5(pid=7241): stdout: | (launched: 2022-12-09_07:26:48.654504) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:50.397263 run osmo-stp_10.42.42.5(pid=7241): stderr: | 20221209072648822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072648822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072648822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072648822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072648823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072648823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072648823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:50.543789 run patchelf(pid=7244): Terminating (SIGINT) 07:26:50.711876 run patchelf(pid=7244): Terminated: ok {rc=0} 07:26:50.833530 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7241): Process ended prematurely: osmo-stp_10.42.42.5(pid=7241) [trial-2356↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7241)] [trial-2356↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 07:26:50.843025 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:26:50.870454 run osmo-hlr_10.42.42.2(pid=7238): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7238)] 07:26:50.917842 run osmo-hlr_10.42.42.2(pid=7238): stdout: | (launched: 2022-12-09_07:26:47.708259) 07:26:50.966973 run osmo-hlr_10.42.42.2(pid=7238): stderr: | 20221209072647882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072647882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072647882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072647882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072647882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072647882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072647894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072647903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072647903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072647903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:51.016571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7231): Terminating (SIGTERM) 07:26:51.055971 run iperf3-srv_10.42.42.10(pid=7232): Terminating (SIGTERM) 07:26:51.095254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7233): Terminating (SIGTERM) 07:26:51.134584 run iperf3-srv_10.42.42.10(pid=7234): Terminating (SIGTERM) 07:26:51.173855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7237): Terminating (SIGTERM) 07:26:51.213252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7240): Terminating (SIGTERM) 07:26:51.252574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7243): Terminating (SIGTERM) 07:26:51.292206 --- ParallelTerminationStrategy: PID 7231 died... 07:26:51.311069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7231): Terminated: ok {rc=0} 07:26:51.355069 --- ParallelTerminationStrategy: PID 7232 died... 07:26:51.373376 run iperf3-srv_10.42.42.10(pid=7232): Terminated {rc=256} 07:26:51.417046 --- ParallelTerminationStrategy: PID 7233 died... 07:26:51.435320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7233): Terminated: ok {rc=0} 07:26:51.479161 --- ParallelTerminationStrategy: PID 7234 died... 07:26:51.497572 run iperf3-srv_10.42.42.10(pid=7234): Terminated {rc=256} 07:26:51.542176 --- ParallelTerminationStrategy: PID 7237 died... 07:26:51.560595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7237): Terminated: ok {rc=0} 07:26:51.605117 --- ParallelTerminationStrategy: PID 7240 died... 07:26:51.623472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7240): Terminated: ok {rc=0} 07:26:51.667515 --- ParallelTerminationStrategy: PID 7243 died... 07:26:51.686025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7243): Terminated: ok {rc=0} 07:26:51.771650 bus /gobi_0: Setting Powered False 07:26:52.873519 bus /gobi_0: Setting Powered False 07:26:53.990839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 07:26:55.135479 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.146932 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:26:55.200115 tst iperf3.py: using LAC 19876 07:26:55.320022 tst iperf3.py: using RAC 241 07:26:55.447501 tst iperf3.py: using CellId 19876 07:26:55.577140 tst iperf3.py: using BVCI 19877 07:26:55.694404 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.705970 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.717244 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.728611 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.739904 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.751144 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.762690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.773917 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:55.785267 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:55.904448 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:26:56.124301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:56.449091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7245): Launched 07:26:56.730570 run iperf3-srv_10.42.42.10(pid=7246): Launched 07:26:56.853705 tst iperf3.py:8: start network... 07:26:57.072323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:57.575802 run create_hlr_db(pid=7247): Launched 07:26:57.707165 bus /gobi_6: Setting Powered False 07:26:58.771247 run create_hlr_db(pid=7247): Terminated: ok {rc=0} 07:26:59.204273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7249): Launched 07:26:59.506183 run osmo-hlr_10.42.42.2(pid=7250): Launched 07:26:59.621749 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:00.142581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7252): Launched 07:27:00.443518 run osmo-stp_10.42.42.5(pid=7253): Launched 07:27:00.558087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:01.100663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7255): Launched 07:27:01.232133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:01.494437 run patchelf(pid=7256): Launched 07:27:01.679070 run osmo-stp_10.42.42.5(pid=7253): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7253)] 07:27:01.809854 run osmo-stp_10.42.42.5(pid=7253): stdout: | (launched: 2022-12-09_07:27:00.388377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:01.943050 run osmo-stp_10.42.42.5(pid=7253): stderr: | 20221209072700555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072700555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072700556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072700556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072700557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072700557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072700557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:02.075338 run osmo-stp_10.42.42.5(pid=7253): stdout: | (launched: 2022-12-09_07:27:00.388377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:02.202153 run osmo-stp_10.42.42.5(pid=7253): stderr: | 20221209072700555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072700555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072700556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072700556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072700557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072700557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072700557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:02.348839 run patchelf(pid=7256): Terminating (SIGINT) 07:27:02.517585 run patchelf(pid=7256): Terminated: ok {rc=0} 07:27:02.639735 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7253): Process ended prematurely: osmo-stp_10.42.42.5(pid=7253) [trial-2356↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7253)] [trial-2356↪gprs:trx-sysmocell5000↪iperf3.py:8] 07:27:02.649436 tst iperf3.py:8: Test FAILED (7.5 sec) 07:27:02.677027 run osmo-hlr_10.42.42.2(pid=7250): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7250)] 07:27:02.724833 run osmo-hlr_10.42.42.2(pid=7250): stdout: | (launched: 2022-12-09_07:26:59.450961) 07:27:02.774353 run osmo-hlr_10.42.42.2(pid=7250): stderr: | 20221209072659623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072659624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072659624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072659624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072659624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072659624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072659637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072659645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072659645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072659645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:02.824419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7245): Terminating (SIGTERM) 07:27:02.864331 run iperf3-srv_10.42.42.10(pid=7246): Terminating (SIGTERM) 07:27:02.905272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7249): Terminating (SIGTERM) 07:27:02.945503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7252): Terminating (SIGTERM) 07:27:02.985207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7255): Terminating (SIGTERM) 07:27:03.025036 --- ParallelTerminationStrategy: PID 7245 died... 07:27:03.043933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7245): Terminated: ok {rc=0} 07:27:03.088331 --- ParallelTerminationStrategy: PID 7246 died... 07:27:03.107008 run iperf3-srv_10.42.42.10(pid=7246): Terminated {rc=256} 07:27:03.150981 --- ParallelTerminationStrategy: PID 7249 died... 07:27:03.169349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7249): Terminated: ok {rc=0} 07:27:03.213389 --- ParallelTerminationStrategy: PID 7252 died... 07:27:03.231904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7252): Terminated: ok {rc=0} 07:27:03.275822 --- ParallelTerminationStrategy: PID 7255 died... 07:27:03.294310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7255): Terminated: ok {rc=0} 07:27:03.380306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 07:27:04.527257 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:04.538803 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:27:04.590441 tst iperf3m4.py: using LAC 19877 07:27:04.710409 tst iperf3m4.py: using RAC 242 07:27:04.827926 tst iperf3m4.py: using CellId 19877 07:27:04.946844 tst iperf3m4.py: using BVCI 19878 07:27:05.057787 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.068561 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.079288 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.090165 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.100938 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.111742 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.122657 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.133412 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:05.144369 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:27:05.264812 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:27:05.388696 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:27:05.508290 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:27:05.628169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:27:05.830927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:06.134052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7257): Launched 07:27:06.397867 run iperf3-srv_10.42.42.10(pid=7258): Launched 07:27:06.510642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:27:06.712757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:07.015306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7259): Launched 07:27:07.277629 run iperf3-srv_10.42.42.10(pid=7260): Launched 07:27:07.390311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:27:07.591844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:07.894007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7261): Launched 07:27:08.157767 run iperf3-srv_10.42.42.10(pid=7262): Launched 07:27:08.270417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:27:08.471968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:08.774861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7263): Launched 07:27:09.036453 run iperf3-srv_10.42.42.10(pid=7264): Launched 07:27:09.149549 tst iperf3m4.py:8: start network... 07:27:09.351060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:09.817695 run create_hlr_db(pid=7265): Launched 07:27:09.932127 bus /gobi_6: Setting Powered False 07:27:10.991739 run create_hlr_db(pid=7265): Terminated: ok {rc=0} 07:27:11.412786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7267): Launched 07:27:11.714740 run osmo-hlr_10.42.42.2(pid=7268): Launched 07:27:11.829092 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:12.353124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7270): Launched 07:27:12.656814 run osmo-stp_10.42.42.5(pid=7271): Launched 07:27:12.772360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:13.292855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7273): Launched 07:27:13.415993 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:13.691180 run patchelf(pid=7274): Launched 07:27:13.871889 run osmo-stp_10.42.42.5(pid=7271): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7271)] 07:27:14.008713 run osmo-stp_10.42.42.5(pid=7271): stdout: | (launched: 2022-12-09_07:27:12.601207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:14.147498 run osmo-stp_10.42.42.5(pid=7271): stderr: | 20221209072712770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072712770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072712771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072712771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072712771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072712772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072712772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:14.286195 run osmo-stp_10.42.42.5(pid=7271): stdout: | (launched: 2022-12-09_07:27:12.601207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:14.419037 run osmo-stp_10.42.42.5(pid=7271): stderr: | 20221209072712770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072712770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072712771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072712771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072712771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072712772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072712772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:14.576484 run patchelf(pid=7274): Terminating (SIGINT) 07:27:14.757156 run patchelf(pid=7274): Terminated: ok {rc=0} 07:27:14.887292 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7271): Process ended prematurely: osmo-stp_10.42.42.5(pid=7271) [trial-2356↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7271)] [trial-2356↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 07:27:14.897642 tst iperf3m4.py:8: Test FAILED (10.4 sec) 07:27:14.926444 run osmo-hlr_10.42.42.2(pid=7268): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7268)] 07:27:14.976318 run osmo-hlr_10.42.42.2(pid=7268): stdout: | (launched: 2022-12-09_07:27:11.659379) 07:27:15.027806 run osmo-hlr_10.42.42.2(pid=7268): stderr: | 20221209072711832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072711832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072711832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072711832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072711832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072711832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072711845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072711854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072711854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072711854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:15.079891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7257): Terminating (SIGTERM) 07:27:15.121529 run iperf3-srv_10.42.42.10(pid=7258): Terminating (SIGTERM) 07:27:15.163092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7259): Terminating (SIGTERM) 07:27:15.204788 run iperf3-srv_10.42.42.10(pid=7260): Terminating (SIGTERM) 07:27:15.246384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7261): Terminating (SIGTERM) 07:27:15.287901 run iperf3-srv_10.42.42.10(pid=7262): Terminating (SIGTERM) 07:27:15.329458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7263): Terminating (SIGTERM) 07:27:15.371067 run iperf3-srv_10.42.42.10(pid=7264): Terminating (SIGTERM) 07:27:15.412471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7267): Terminating (SIGTERM) 07:27:15.454022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7270): Terminating (SIGTERM) 07:27:15.495576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7273): Terminating (SIGTERM) 07:27:15.537936 --- ParallelTerminationStrategy: PID 7257 died... 07:27:15.557836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7257): Terminated: ok {rc=0} 07:27:15.604298 --- ParallelTerminationStrategy: PID 7258 died... 07:27:15.623934 run iperf3-srv_10.42.42.10(pid=7258): Terminated {rc=256} 07:27:15.669731 --- ParallelTerminationStrategy: PID 7259 died... 07:27:15.689246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7259): Terminated: ok {rc=0} 07:27:15.734971 --- ParallelTerminationStrategy: PID 7260 died... 07:27:15.754376 run iperf3-srv_10.42.42.10(pid=7260): Terminated {rc=256} 07:27:15.800451 --- ParallelTerminationStrategy: PID 7261 died... 07:27:15.819928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7261): Terminated: ok {rc=0} 07:27:15.882578 --- ParallelTerminationStrategy: PID 7262 died... 07:27:15.902126 run iperf3-srv_10.42.42.10(pid=7262): Terminated {rc=256} 07:27:15.950408 --- ParallelTerminationStrategy: PID 7263 died... 07:27:15.971437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7263): Terminated: ok {rc=0} 07:27:16.018708 --- ParallelTerminationStrategy: PID 7264 died... 07:27:16.037788 run iperf3-srv_10.42.42.10(pid=7264): Terminated {rc=256} 07:27:16.085844 --- ParallelTerminationStrategy: PID 7267 died... 07:27:16.105640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7267): Terminated: ok {rc=0} 07:27:16.152630 --- ParallelTerminationStrategy: PID 7270 died... 07:27:16.173243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7270): Terminated: ok {rc=0} 07:27:16.220525 --- ParallelTerminationStrategy: PID 7273 died... 07:27:16.240120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7273): Terminated: ok {rc=0} 07:27:16.327245 bus /gobi_4: Setting Powered False 07:27:17.426741 bus /gobi_4: Setting Powered False 07:27:18.543020 bus /gobi_1: Setting Powered False 07:27:19.640262 bus /gobi_1: Setting Powered False 07:27:20.754756 bus /gobi_0: Setting Powered False 07:27:21.851575 bus /gobi_0: Setting Powered False 07:27:22.968615 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 07:27:24.072151 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.083843 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:27:24.134982 tst ping.py: using LAC 19878 07:27:24.250384 tst ping.py: using RAC 243 07:27:24.367731 tst ping.py: using CellId 19878 07:27:24.485374 tst ping.py: using BVCI 19879 07:27:24.594491 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.605408 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.616135 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.627414 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.638351 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.649155 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.660149 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:24.671049 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:27:24.789228 tst ping.py:19: start network... 07:27:25.002785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:25.492603 run create_hlr_db(pid=7275): Launched 07:27:25.621603 bus /gobi_6: Setting Powered False 07:27:26.683850 run create_hlr_db(pid=7275): Terminated: ok {rc=0} 07:27:27.105535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7277): Launched 07:27:27.422501 run osmo-hlr_10.42.42.2(pid=7278): Launched 07:27:27.544463 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:28.094035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7280): Launched 07:27:28.413083 run osmo-stp_10.42.42.5(pid=7281): Launched 07:27:28.534105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:29.082759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7283): Launched 07:27:29.203255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:29.471082 run patchelf(pid=7284): Launched 07:27:29.649487 run osmo-stp_10.42.42.5(pid=7281): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7281)] 07:27:29.783230 run osmo-stp_10.42.42.5(pid=7281): stdout: | (launched: 2022-12-09_07:27:28.354963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:29.918403 run osmo-stp_10.42.42.5(pid=7281): stderr: | 20221209072728542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072728543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072728543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072728543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072728544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072728544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072728544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:30.053598 run osmo-stp_10.42.42.5(pid=7281): stdout: | (launched: 2022-12-09_07:27:28.354963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:30.183544 run osmo-stp_10.42.42.5(pid=7281): stderr: | 20221209072728542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072728543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072728543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072728543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072728544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072728544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072728544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:30.337054 run patchelf(pid=7284): Terminating (SIGINT) 07:27:30.512645 run patchelf(pid=7284): Terminated: ok {rc=0} 07:27:30.639953 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7281): Process ended prematurely: osmo-stp_10.42.42.5(pid=7281) [trial-2356↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7281)] [trial-2356↪gprs:trx-sysmocell5000↪ping.py:22] 07:27:30.649623 tst ping.py:22: Test FAILED (6.6 sec) 07:27:30.677613 run osmo-hlr_10.42.42.2(pid=7278): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7278)] 07:27:30.727358 run osmo-hlr_10.42.42.2(pid=7278): stdout: | (launched: 2022-12-09_07:27:27.364533) 07:27:30.778853 run osmo-hlr_10.42.42.2(pid=7278): stderr: | 20221209072727557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072727557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072727557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072727557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072727558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072727558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072727570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072727579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072727579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072727579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:30.831354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7277): Terminating (SIGTERM) 07:27:30.891881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7280): Terminating (SIGTERM) 07:27:30.945380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7283): Terminating (SIGTERM) 07:27:31.002568 --- ParallelTerminationStrategy: PID 7277 died... 07:27:31.023177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7277): Terminated: ok {rc=0} 07:27:31.070298 --- ParallelTerminationStrategy: PID 7280 died... 07:27:31.090300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7280): Terminated: ok {rc=0} 07:27:31.137294 --- ParallelTerminationStrategy: PID 7283 died... 07:27:31.157346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7283): Terminated: ok {rc=0} 07:27:31.252189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 07:27:32.352197 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.364331 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:27:32.417036 tst ping_idle_ping.py: using LAC 19879 07:27:32.545523 tst ping_idle_ping.py: using RAC 244 07:27:32.670540 tst ping_idle_ping.py: using CellId 19879 07:27:32.793260 tst ping_idle_ping.py: using BVCI 19880 07:27:32.902516 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.913758 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.924612 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.936258 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.947934 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.959649 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.971546 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:27:32.983487 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:27:33.105148 tst ping_idle_ping.py:24: start network... 07:27:33.319057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:33.815709 run create_hlr_db(pid=7285): Launched 07:27:33.931036 bus /gobi_6: Setting Powered False 07:27:34.990343 run create_hlr_db(pid=7285): Terminated: ok {rc=0} 07:27:35.403724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7287): Launched 07:27:35.699871 run osmo-hlr_10.42.42.2(pid=7288): Launched 07:27:35.820493 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:36.345354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7291): Launched 07:27:36.640399 run osmo-stp_10.42.42.5(pid=7292): Launched 07:27:36.753574 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:37.263663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7294): Launched 07:27:37.377251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:37.628084 run patchelf(pid=7295): Launched 07:27:37.792301 run osmo-stp_10.42.42.5(pid=7292): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7292)] 07:27:37.918100 run osmo-stp_10.42.42.5(pid=7292): stdout: | (launched: 2022-12-09_07:27:36.585991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:38.045626 run osmo-stp_10.42.42.5(pid=7292): stderr: | 20221209072736751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072736751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072736751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072736752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072736752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072736752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072736753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:38.173148 run osmo-stp_10.42.42.5(pid=7292): stdout: | (launched: 2022-12-09_07:27:36.585991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:38.295888 run osmo-stp_10.42.42.5(pid=7292): stderr: | 20221209072736751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072736751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072736751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072736752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072736752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072736752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072736753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:38.440393 run patchelf(pid=7295): Terminating (SIGINT) 07:27:38.605821 run patchelf(pid=7295): Terminated: ok {rc=0} 07:27:38.725297 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7292): Process ended prematurely: osmo-stp_10.42.42.5(pid=7292) [trial-2356↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7292)] [trial-2356↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 07:27:38.734426 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:27:38.761205 run osmo-hlr_10.42.42.2(pid=7288): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7288)] 07:27:38.809156 run osmo-hlr_10.42.42.2(pid=7288): stdout: | (launched: 2022-12-09_07:27:35.645320) 07:27:38.858527 run osmo-hlr_10.42.42.2(pid=7288): stderr: | 20221209072735822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072735822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072735822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072735822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072735823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072735823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072735835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072735846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072735846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072735846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:38.908418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7287): Terminating (SIGTERM) 07:27:38.948215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7291): Terminating (SIGTERM) 07:27:38.988195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7294): Terminating (SIGTERM) 07:27:39.028342 --- ParallelTerminationStrategy: PID 7287 died... 07:27:39.047410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7287): Terminated: ok {rc=0} 07:27:39.092050 --- ParallelTerminationStrategy: PID 7291 died... 07:27:39.110653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7291): Terminated: ok {rc=0} 07:27:39.154643 --- ParallelTerminationStrategy: PID 7294 died... 07:27:39.173365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7294): Terminated: ok {rc=0} 07:27:39.256111 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 07:27:40.575727 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:27:40.582004 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:27:40.619807 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:27:40.660178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:27:40.750543 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:27:40.785879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:27:40.826123 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:27:41.423361 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:27:41.476092 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:41.487701 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:27:41.542193 tst cs_paging_gprs_active.py: using LAC 19880 07:27:41.670585 tst cs_paging_gprs_active.py: using RAC 245 07:27:41.798731 tst cs_paging_gprs_active.py: using CellId 19880 07:27:41.927492 tst cs_paging_gprs_active.py: using BVCI 19881 07:27:42.045461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.057000 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.068203 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.080012 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.092454 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.104255 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.115406 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.126460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:42.137824 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:27:42.256417 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:27:42.375229 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:27:42.578462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:42.881981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7299): Launched 07:27:43.144020 run iperf3-srv_10.42.42.10(pid=7300): Launched 07:27:43.257156 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:27:43.459298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:43.763166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7301): Launched 07:27:44.026250 run iperf3-srv_10.42.42.10(pid=7302): Launched 07:27:44.139742 tst cs_paging_gprs_active.py:38: start network... 07:27:44.342801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:44.813173 run create_hlr_db(pid=7303): Launched 07:27:44.929640 bus /gobi_6: Setting Powered False 07:27:46.000053 run create_hlr_db(pid=7303): Terminated: ok {rc=0} 07:27:46.465429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7305): Launched 07:27:46.811809 run osmo-hlr_10.42.42.2(pid=7306): Launched 07:27:46.968573 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:47.583510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7308): Launched 07:27:47.886625 run osmo-stp_10.42.42.5(pid=7309): Launched 07:27:48.001930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:48.523899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7311): Launched 07:27:48.639016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:48.893663 run patchelf(pid=7312): Launched 07:27:49.060847 run osmo-stp_10.42.42.5(pid=7309): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7309)] 07:27:49.188211 run osmo-stp_10.42.42.5(pid=7309): stdout: | (launched: 2022-12-09_07:27:47.831163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:49.316859 run osmo-stp_10.42.42.5(pid=7309): stderr: | 20221209072747999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072747999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072747999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072747999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072748000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072748000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072748000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:49.446305 run osmo-stp_10.42.42.5(pid=7309): stdout: | (launched: 2022-12-09_07:27:47.831163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:49.569948 run osmo-stp_10.42.42.5(pid=7309): stderr: | 20221209072747999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072747999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072747999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072747999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072748000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072748000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072748000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:49.716366 run patchelf(pid=7312): Terminating (SIGINT) 07:27:49.884639 run patchelf(pid=7312): Terminated: ok {rc=0} 07:27:50.006337 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7309): Process ended prematurely: osmo-stp_10.42.42.5(pid=7309) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7309)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:27:50.015761 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:27:50.043079 run osmo-hlr_10.42.42.2(pid=7306): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7306)] 07:27:50.091241 run osmo-hlr_10.42.42.2(pid=7306): stdout: | (launched: 2022-12-09_07:27:46.747952) 07:27:50.140536 run osmo-hlr_10.42.42.2(pid=7306): stderr: | 20221209072747152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072747152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072747152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072747152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072747152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072747152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072747164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072747184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072747189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072747189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:50.190287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7299): Terminating (SIGTERM) 07:27:50.230047 run iperf3-srv_10.42.42.10(pid=7300): Terminating (SIGTERM) 07:27:50.269612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7301): Terminating (SIGTERM) 07:27:50.309159 run iperf3-srv_10.42.42.10(pid=7302): Terminating (SIGTERM) 07:27:50.348816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7305): Terminating (SIGTERM) 07:27:50.388324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7308): Terminating (SIGTERM) 07:27:50.428068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7311): Terminating (SIGTERM) 07:27:50.468040 --- ParallelTerminationStrategy: PID 7299 died... 07:27:50.486879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7299): Terminated: ok {rc=0} 07:27:50.530686 --- ParallelTerminationStrategy: PID 7300 died... 07:27:50.549117 run iperf3-srv_10.42.42.10(pid=7300): Terminated {rc=256} 07:27:50.593287 --- ParallelTerminationStrategy: PID 7301 died... 07:27:50.611691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7301): Terminated: ok {rc=0} 07:27:50.655473 --- ParallelTerminationStrategy: PID 7302 died... 07:27:50.673799 run iperf3-srv_10.42.42.10(pid=7302): Terminated {rc=256} 07:27:50.717559 --- ParallelTerminationStrategy: PID 7305 died... 07:27:50.735694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7305): Terminated: ok {rc=0} 07:27:50.779116 --- ParallelTerminationStrategy: PID 7308 died... 07:27:50.797618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7308): Terminated: ok {rc=0} 07:27:50.841334 --- ParallelTerminationStrategy: PID 7311 died... 07:27:50.859653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7311): Terminated: ok {rc=0} 07:27:50.945115 bus /gobi_0: Setting Powered False 07:27:52.044205 bus /gobi_0: Setting Powered False 07:27:53.159601 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:27:54.308153 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.320640 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:27:54.377376 tst iperf3.py: using LAC 19881 07:27:54.505217 tst iperf3.py: using RAC 246 07:27:54.634265 tst iperf3.py: using CellId 19881 07:27:54.759621 tst iperf3.py: using BVCI 19882 07:27:54.877325 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.889207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.900503 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.912009 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.923369 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.934891 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.946531 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.957935 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:54.969597 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:27:55.087438 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:27:55.290996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:55.593627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7313): Launched 07:27:55.855313 run iperf3-srv_10.42.42.10(pid=7314): Launched 07:27:55.968330 tst iperf3.py:8: start network... 07:27:56.170461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:56.636525 run create_hlr_db(pid=7315): Launched 07:27:56.751286 bus /gobi_6: Setting Powered False 07:27:57.810485 run create_hlr_db(pid=7315): Terminated: ok {rc=0} 07:27:58.250110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7317): Launched 07:27:58.575240 run osmo-hlr_10.42.42.2(pid=7318): Launched 07:27:58.699169 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:59.256720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7320): Launched 07:27:59.578412 run osmo-stp_10.42.42.5(pid=7321): Launched 07:27:59.701484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:00.257253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7323): Launched 07:28:00.380246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:00.655245 run patchelf(pid=7324): Launched 07:28:00.841677 run osmo-stp_10.42.42.5(pid=7321): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7321)] 07:28:01.013805 run osmo-stp_10.42.42.5(pid=7321): stdout: | (launched: 2022-12-09_07:27:59.519173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:01.192572 run osmo-stp_10.42.42.5(pid=7321): stderr: | 20221209072759705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072759706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072759706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072759706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072759707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072759707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072759707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:01.372555 run osmo-stp_10.42.42.5(pid=7321): stdout: | (launched: 2022-12-09_07:27:59.519173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:01.523955 run osmo-stp_10.42.42.5(pid=7321): stderr: | 20221209072759705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072759706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072759706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072759706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072759707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072759707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072759707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:01.685015 run patchelf(pid=7324): Terminating (SIGINT) 07:28:01.868352 run patchelf(pid=7324): Terminated: ok {rc=0} 07:28:02.000912 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7321): Process ended prematurely: osmo-stp_10.42.42.5(pid=7321) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7321)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 07:28:02.012399 tst iperf3.py:8: Test FAILED (7.7 sec) 07:28:02.042051 run osmo-hlr_10.42.42.2(pid=7318): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7318)] 07:28:02.094239 run osmo-hlr_10.42.42.2(pid=7318): stdout: | (launched: 2022-12-09_07:27:58.516081) 07:28:02.147603 run osmo-hlr_10.42.42.2(pid=7318): stderr: | 20221209072758710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072758710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072758710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072758710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072758710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072758710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072758722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072758731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072758731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072758731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:02.201491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7313): Terminating (SIGTERM) 07:28:02.245311 run iperf3-srv_10.42.42.10(pid=7314): Terminating (SIGTERM) 07:28:02.291313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7317): Terminating (SIGTERM) 07:28:02.334421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7320): Terminating (SIGTERM) 07:28:02.375929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7323): Terminating (SIGTERM) 07:28:02.418379 --- ParallelTerminationStrategy: PID 7313 died... 07:28:02.438572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7313): Terminated: ok {rc=0} 07:28:02.484796 --- ParallelTerminationStrategy: PID 7314 died... 07:28:02.504387 run iperf3-srv_10.42.42.10(pid=7314): Terminated {rc=256} 07:28:02.550133 --- ParallelTerminationStrategy: PID 7317 died... 07:28:02.569957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7317): Terminated: ok {rc=0} 07:28:02.616371 --- ParallelTerminationStrategy: PID 7320 died... 07:28:02.636003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7320): Terminated: ok {rc=0} 07:28:02.681856 --- ParallelTerminationStrategy: PID 7323 died... 07:28:02.701601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7323): Terminated: ok {rc=0} 07:28:02.789031 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:28:03.935516 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:03.947780 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:28:04.003711 tst iperf3m4.py: using LAC 19882 07:28:04.132669 tst iperf3m4.py: using RAC 247 07:28:04.258217 tst iperf3m4.py: using CellId 19882 07:28:04.387004 tst iperf3m4.py: using BVCI 19883 07:28:04.499495 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.510830 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.522068 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.533110 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.543894 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.554976 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.567739 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.582051 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:04.594153 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:28:04.715713 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:28:04.834070 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:28:04.956160 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:28:05.075321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:28:05.279564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:05.584077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7325): Launched 07:28:05.846993 run iperf3-srv_10.42.42.10(pid=7326): Launched 07:28:05.960573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:28:06.163682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:06.467957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7327): Launched 07:28:06.731378 run iperf3-srv_10.42.42.10(pid=7328): Launched 07:28:06.844740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:28:07.047935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:07.352192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7329): Launched 07:28:07.615527 run iperf3-srv_10.42.42.10(pid=7330): Launched 07:28:07.729394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:28:07.932355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:08.236439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7331): Launched 07:28:08.500331 run iperf3-srv_10.42.42.10(pid=7332): Launched 07:28:08.613539 tst iperf3m4.py:8: start network... 07:28:08.816542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:09.285999 run create_hlr_db(pid=7333): Launched 07:28:09.400302 bus /gobi_6: Setting Powered False 07:28:10.461203 run create_hlr_db(pid=7333): Terminated: ok {rc=0} 07:28:10.904292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7335): Launched 07:28:11.227690 run osmo-hlr_10.42.42.2(pid=7336): Launched 07:28:11.350890 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:11.908351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7338): Launched 07:28:12.231155 run osmo-stp_10.42.42.5(pid=7339): Launched 07:28:12.353684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:12.911493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7341): Launched 07:28:13.036372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:13.310220 run patchelf(pid=7342): Launched 07:28:13.491120 run osmo-stp_10.42.42.5(pid=7339): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7339)] 07:28:13.628180 run osmo-stp_10.42.42.5(pid=7339): stdout: | (launched: 2022-12-09_07:28:12.171859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:13.766275 run osmo-stp_10.42.42.5(pid=7339): stderr: | 20221209072812358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072812358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072812358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072812359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072812359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072812359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072812359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:13.904097 run osmo-stp_10.42.42.5(pid=7339): stdout: | (launched: 2022-12-09_07:28:12.171859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:14.036350 run osmo-stp_10.42.42.5(pid=7339): stderr: | 20221209072812358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072812358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072812358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072812359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072812359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072812359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072812359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:14.193314 run patchelf(pid=7342): Terminating (SIGINT) 07:28:14.373650 run patchelf(pid=7342): Terminated: ok {rc=0} 07:28:14.503372 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7339): Process ended prematurely: osmo-stp_10.42.42.5(pid=7339) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7339)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 07:28:14.514352 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:28:14.543398 run osmo-hlr_10.42.42.2(pid=7336): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7336)] 07:28:14.593738 run osmo-hlr_10.42.42.2(pid=7336): stdout: | (launched: 2022-12-09_07:28:11.168487) 07:28:14.645553 run osmo-hlr_10.42.42.2(pid=7336): stderr: | 20221209072811360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072811361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072811361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072811361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072811361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072811361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072811373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072811382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072811382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072811383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:14.697565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7325): Terminating (SIGTERM) 07:28:14.739326 run iperf3-srv_10.42.42.10(pid=7326): Terminating (SIGTERM) 07:28:14.780989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7327): Terminating (SIGTERM) 07:28:14.822654 run iperf3-srv_10.42.42.10(pid=7328): Terminating (SIGTERM) 07:28:14.864108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7329): Terminating (SIGTERM) 07:28:14.905785 run iperf3-srv_10.42.42.10(pid=7330): Terminating (SIGTERM) 07:28:14.947111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7331): Terminating (SIGTERM) 07:28:14.988767 run iperf3-srv_10.42.42.10(pid=7332): Terminating (SIGTERM) 07:28:15.030352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7335): Terminating (SIGTERM) 07:28:15.071862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7338): Terminating (SIGTERM) 07:28:15.113480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7341): Terminating (SIGTERM) 07:28:15.155355 --- ParallelTerminationStrategy: PID 7325 died... 07:28:15.175174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7325): Terminated: ok {rc=0} 07:28:15.221076 --- ParallelTerminationStrategy: PID 7326 died... 07:28:15.240321 run iperf3-srv_10.42.42.10(pid=7326): Terminated {rc=256} 07:28:15.286029 --- ParallelTerminationStrategy: PID 7327 died... 07:28:15.305553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7327): Terminated: ok {rc=0} 07:28:15.351347 --- ParallelTerminationStrategy: PID 7328 died... 07:28:15.370866 run iperf3-srv_10.42.42.10(pid=7328): Terminated {rc=256} 07:28:15.416493 --- ParallelTerminationStrategy: PID 7329 died... 07:28:15.435987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7329): Terminated: ok {rc=0} 07:28:15.482046 --- ParallelTerminationStrategy: PID 7330 died... 07:28:15.501551 run iperf3-srv_10.42.42.10(pid=7330): Terminated {rc=256} 07:28:15.547225 --- ParallelTerminationStrategy: PID 7331 died... 07:28:15.567001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7331): Terminated: ok {rc=0} 07:28:15.612939 --- ParallelTerminationStrategy: PID 7332 died... 07:28:15.632442 run iperf3-srv_10.42.42.10(pid=7332): Terminated {rc=256} 07:28:15.678042 --- ParallelTerminationStrategy: PID 7335 died... 07:28:15.697545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7335): Terminated: ok {rc=0} 07:28:15.743123 --- ParallelTerminationStrategy: PID 7338 died... 07:28:15.762675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7338): Terminated: ok {rc=0} 07:28:15.808286 --- ParallelTerminationStrategy: PID 7341 died... 07:28:15.827831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7341): Terminated: ok {rc=0} 07:28:15.923950 bus /gobi_4: Setting Powered False 07:28:17.046600 bus /gobi_4: Setting Powered False 07:28:18.172335 bus /gobi_1: Setting Powered False 07:28:19.270368 bus /gobi_1: Setting Powered False 07:28:20.385382 bus /gobi_0: Setting Powered False 07:28:21.482925 bus /gobi_0: Setting Powered False 07:28:22.598182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 07:28:23.701034 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:23.713326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:28:23.765552 tst ping.py: using LAC 19883 07:28:23.882117 tst ping.py: using RAC 248 07:28:23.998193 tst ping.py: using CellId 19883 07:28:24.113054 tst ping.py: using BVCI 19884 07:28:24.220364 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.231545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.242585 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.253395 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.264376 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.275229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.286183 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:24.297027 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:28:24.419583 tst ping.py:19: start network... 07:28:24.634808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:25.127401 run create_hlr_db(pid=7344): Launched 07:28:25.256121 bus /gobi_6: Setting Powered False 07:28:26.318339 run create_hlr_db(pid=7344): Terminated: ok {rc=0} 07:28:26.761442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Launched 07:28:27.079992 run osmo-hlr_10.42.42.2(pid=7347): Launched 07:28:27.200670 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:27.756190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Launched 07:28:28.074725 run osmo-stp_10.42.42.5(pid=7350): Launched 07:28:28.197030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:28.748092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7352): Launched 07:28:28.869584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:29.138780 run patchelf(pid=7353): Launched 07:28:29.315636 run osmo-stp_10.42.42.5(pid=7350): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] 07:28:29.450355 run osmo-stp_10.42.42.5(pid=7350): stdout: | (launched: 2022-12-09_07:28:28.016356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:29.586495 run osmo-stp_10.42.42.5(pid=7350): stderr: | 20221209072828206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072828206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072828206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072828207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072828207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072828207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072828207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:29.723287 run osmo-stp_10.42.42.5(pid=7350): stdout: | (launched: 2022-12-09_07:28:28.016356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:29.853290 run osmo-stp_10.42.42.5(pid=7350): stderr: | 20221209072828206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072828206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072828206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072828207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072828207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072828207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072828207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:30.007787 run patchelf(pid=7353): Terminating (SIGINT) 07:28:30.184327 run patchelf(pid=7353): Terminated: ok {rc=0} 07:28:30.311915 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7350): Process ended prematurely: osmo-stp_10.42.42.5(pid=7350) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 07:28:30.321604 tst ping.py:22: Test FAILED (6.6 sec) 07:28:30.349635 run osmo-hlr_10.42.42.2(pid=7347): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7347)] 07:28:30.399417 run osmo-hlr_10.42.42.2(pid=7347): stdout: | (launched: 2022-12-09_07:28:27.021960) 07:28:30.451120 run osmo-hlr_10.42.42.2(pid=7347): stderr: | 20221209072827216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072827216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072827216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072827217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072827217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072827217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072827229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072827237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072827237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072827237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:30.502910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Terminating (SIGTERM) 07:28:30.544430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Terminating (SIGTERM) 07:28:30.586680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7352): Terminating (SIGTERM) 07:28:30.629101 --- ParallelTerminationStrategy: PID 7346 died... 07:28:30.649448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Terminated: ok {rc=0} 07:28:30.695729 --- ParallelTerminationStrategy: PID 7349 died... 07:28:30.715501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Terminated: ok {rc=0} 07:28:30.761530 --- ParallelTerminationStrategy: PID 7352 died... 07:28:30.781164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7352): Terminated: ok {rc=0} 07:28:30.881472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:28:31.984309 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:31.998844 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:28:32.060267 tst ping_idle_ping.py: using LAC 19884 07:28:32.181487 tst ping_idle_ping.py: using RAC 249 07:28:32.307946 tst ping_idle_ping.py: using CellId 19884 07:28:32.435010 tst ping_idle_ping.py: using BVCI 19885 07:28:32.552852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.564642 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.576570 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.588149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.599515 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.610781 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.622501 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:28:32.633895 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:28:32.750701 tst ping_idle_ping.py:24: start network... 07:28:32.948329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:33.410933 run create_hlr_db(pid=7354): Launched 07:28:33.525245 bus /gobi_6: Setting Powered False 07:28:34.584268 run create_hlr_db(pid=7354): Terminated: ok {rc=0} 07:28:35.020068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7356): Launched 07:28:35.339124 run osmo-hlr_10.42.42.2(pid=7357): Launched 07:28:35.460808 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:36.011395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7359): Launched 07:28:36.330731 run osmo-stp_10.42.42.5(pid=7360): Launched 07:28:36.454082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:37.006776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7362): Launched 07:28:37.129800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:37.400055 run patchelf(pid=7363): Launched 07:28:37.578813 run osmo-stp_10.42.42.5(pid=7360): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7360)] 07:28:37.714003 run osmo-stp_10.42.42.5(pid=7360): stdout: | (launched: 2022-12-09_07:28:36.272489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:37.850372 run osmo-stp_10.42.42.5(pid=7360): stderr: | 20221209072836461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072836461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072836461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072836461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072836462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072836462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072836462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:37.986183 run osmo-stp_10.42.42.5(pid=7360): stdout: | (launched: 2022-12-09_07:28:36.272489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:38.117102 run osmo-stp_10.42.42.5(pid=7360): stderr: | 20221209072836461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072836461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072836461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072836461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072836462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072836462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072836462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:38.271690 run patchelf(pid=7363): Terminating (SIGINT) 07:28:38.449448 run patchelf(pid=7363): Terminated: ok {rc=0} 07:28:38.577594 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7360): Process ended prematurely: osmo-stp_10.42.42.5(pid=7360) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7360)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 07:28:38.587614 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:28:38.615484 run osmo-hlr_10.42.42.2(pid=7357): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7357)] 07:28:38.665109 run osmo-hlr_10.42.42.2(pid=7357): stdout: | (launched: 2022-12-09_07:28:35.280533) 07:28:38.716350 run osmo-hlr_10.42.42.2(pid=7357): stderr: | 20221209072835474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072835474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072835474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072835474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072835474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072835474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072835486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072835495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072835495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072835495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:38.767794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7356): Terminating (SIGTERM) 07:28:38.809163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7359): Terminating (SIGTERM) 07:28:38.850432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7362): Terminating (SIGTERM) 07:28:38.892053 --- ParallelTerminationStrategy: PID 7356 died... 07:28:38.912001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7356): Terminated: ok {rc=0} 07:28:38.958080 --- ParallelTerminationStrategy: PID 7359 died... 07:28:38.977428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7359): Terminated: ok {rc=0} 07:28:39.023317 --- ParallelTerminationStrategy: PID 7362 died... 07:28:39.042883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7362): Terminated: ok {rc=0} 07:28:39.129888 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:28:40.443182 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:28:40.449602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:28:40.483948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:28:40.524259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:28:40.614154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:28:40.647831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:28:40.686465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:28:41.282814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:28:41.331072 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.342306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:28:41.414350 tst cs_paging_gprs_active.py: using LAC 19885 07:28:41.544304 tst cs_paging_gprs_active.py: using RAC 250 07:28:41.670842 tst cs_paging_gprs_active.py: using CellId 19885 07:28:41.799632 tst cs_paging_gprs_active.py: using BVCI 19886 07:28:41.919076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.930688 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.942154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.953478 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.964663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.976013 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.987531 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:41.998784 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:42.010227 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:28:42.132785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:28:42.250766 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:28:42.453414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:42.757127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7367): Launched 07:28:43.019128 run iperf3-srv_10.42.42.10(pid=7368): Launched 07:28:43.131829 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:28:43.333876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:43.636849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7369): Launched 07:28:43.899317 run iperf3-srv_10.42.42.10(pid=7370): Launched 07:28:44.012168 tst cs_paging_gprs_active.py:38: start network... 07:28:44.214645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:44.682557 run create_hlr_db(pid=7371): Launched 07:28:44.797934 bus /gobi_6: Setting Powered False 07:28:45.870846 run create_hlr_db(pid=7371): Terminated: ok {rc=0} 07:28:46.348269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7373): Launched 07:28:46.725214 run osmo-hlr_10.42.42.2(pid=7374): Launched 07:28:46.939730 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:47.653446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7376): Launched 07:28:47.976011 run osmo-stp_10.42.42.5(pid=7377): Launched 07:28:48.098551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:48.657417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7379): Launched 07:28:48.780311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:49.053065 run patchelf(pid=7380): Launched 07:28:49.231819 run osmo-stp_10.42.42.5(pid=7377): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7377)] 07:28:49.368120 run osmo-stp_10.42.42.5(pid=7377): stdout: | (launched: 2022-12-09_07:28:47.917385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:49.506482 run osmo-stp_10.42.42.5(pid=7377): stderr: | 20221209072848105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072848105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072848105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072848106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072848106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072848106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072848106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:49.644667 run osmo-stp_10.42.42.5(pid=7377): stdout: | (launched: 2022-12-09_07:28:47.917385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:49.776803 run osmo-stp_10.42.42.5(pid=7377): stderr: | 20221209072848105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072848105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072848105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072848106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072848106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072848106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072848106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:49.933554 run patchelf(pid=7380): Terminating (SIGINT) 07:28:50.113282 run patchelf(pid=7380): Terminated: ok {rc=0} 07:28:50.242934 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7377): Process ended prematurely: osmo-stp_10.42.42.5(pid=7377) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7377)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:28:50.253239 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 07:28:50.281397 run osmo-hlr_10.42.42.2(pid=7374): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7374)] 07:28:50.331127 run osmo-hlr_10.42.42.2(pid=7374): stdout: | (launched: 2022-12-09_07:28:46.664143) 07:28:50.382334 run osmo-hlr_10.42.42.2(pid=7374): stderr: | 20221209072847028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072847028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072847028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072847028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072847028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072847029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072847051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072847066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072847066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072847066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:50.434018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7367): Terminating (SIGTERM) 07:28:50.474942 run iperf3-srv_10.42.42.10(pid=7368): Terminating (SIGTERM) 07:28:50.515975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7369): Terminating (SIGTERM) 07:28:50.556817 run iperf3-srv_10.42.42.10(pid=7370): Terminating (SIGTERM) 07:28:50.598224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7373): Terminating (SIGTERM) 07:28:50.639431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7376): Terminating (SIGTERM) 07:28:50.680546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7379): Terminating (SIGTERM) 07:28:50.722020 --- ParallelTerminationStrategy: PID 7367 died... 07:28:50.741585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7367): Terminated: ok {rc=0} 07:28:50.787294 --- ParallelTerminationStrategy: PID 7368 died... 07:28:50.807633 run iperf3-srv_10.42.42.10(pid=7368): Terminated {rc=256} 07:28:50.853293 --- ParallelTerminationStrategy: PID 7369 died... 07:28:50.872514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7369): Terminated: ok {rc=0} 07:28:50.917810 --- ParallelTerminationStrategy: PID 7370 died... 07:28:50.937069 run iperf3-srv_10.42.42.10(pid=7370): Terminated {rc=256} 07:28:50.982515 --- ParallelTerminationStrategy: PID 7373 died... 07:28:51.001846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7373): Terminated: ok {rc=0} 07:28:51.047838 --- ParallelTerminationStrategy: PID 7376 died... 07:28:51.067319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7376): Terminated: ok {rc=0} 07:28:51.112866 --- ParallelTerminationStrategy: PID 7379 died... 07:28:51.132249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7379): Terminated: ok {rc=0} 07:28:51.219053 bus /gobi_0: Setting Powered False 07:28:52.315183 bus /gobi_0: Setting Powered False 07:28:53.429700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:28:54.579291 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:54.591629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:28:54.667577 tst iperf3.py: using LAC 19886 07:28:54.787332 tst iperf3.py: using RAC 251 07:28:54.906999 tst iperf3.py: using CellId 19886 07:28:55.026790 tst iperf3.py: using BVCI 19887 07:28:55.137385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.149295 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.160098 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.170910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.181681 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.192436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.203395 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.214221 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:55.225919 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:28:55.346797 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:28:55.565078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:55.889185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7383): Launched 07:28:56.170970 run iperf3-srv_10.42.42.10(pid=7386): Launched 07:28:56.293084 tst iperf3.py:8: start network... 07:28:56.511011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:57.013609 run create_hlr_db(pid=7387): Launched 07:28:57.144678 bus /gobi_6: Setting Powered False 07:28:58.208607 run create_hlr_db(pid=7387): Terminated: ok {rc=0} 07:28:58.639493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7389): Launched 07:28:58.942456 run osmo-hlr_10.42.42.2(pid=7390): Launched 07:28:59.056594 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:59.591038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7392): Launched 07:28:59.893150 run osmo-stp_10.42.42.5(pid=7393): Launched 07:29:00.007699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:00.526712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7395): Launched 07:29:00.643539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:00.945732 run patchelf(pid=7396): Launched 07:29:01.174489 run osmo-stp_10.42.42.5(pid=7393): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7393)] 07:29:01.319095 run osmo-stp_10.42.42.5(pid=7393): stdout: | (launched: 2022-12-09_07:28:59.838009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:01.480832 run osmo-stp_10.42.42.5(pid=7393): stderr: | 20221209072900004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072900004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072900004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072900004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072900005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072900005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072900005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:01.634278 run osmo-stp_10.42.42.5(pid=7393): stdout: | (launched: 2022-12-09_07:28:59.838009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:01.768714 run osmo-stp_10.42.42.5(pid=7393): stderr: | 20221209072900004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072900004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072900004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072900004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072900005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072900005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072900005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:01.930374 run patchelf(pid=7396): Terminating (SIGINT) 07:29:02.116441 run patchelf(pid=7396): Terminated: ok {rc=0} 07:29:02.248798 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7393): Process ended prematurely: osmo-stp_10.42.42.5(pid=7393) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7393)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 07:29:02.259053 tst iperf3.py:8: Test FAILED (7.7 sec) 07:29:02.287589 run osmo-hlr_10.42.42.2(pid=7390): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7390)] 07:29:02.338073 run osmo-hlr_10.42.42.2(pid=7390): stdout: | (launched: 2022-12-09_07:28:58.887172) 07:29:02.389994 run osmo-hlr_10.42.42.2(pid=7390): stderr: | 20221209072859062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072859062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072859062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072859062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072859062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072859062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072859075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072859083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072859084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072859084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:02.442466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7383): Terminating (SIGTERM) 07:29:02.483985 run iperf3-srv_10.42.42.10(pid=7386): Terminating (SIGTERM) 07:29:02.525493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7389): Terminating (SIGTERM) 07:29:02.567659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7392): Terminating (SIGTERM) 07:29:02.610100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7395): Terminating (SIGTERM) 07:29:02.652179 --- ParallelTerminationStrategy: PID 7383 died... 07:29:02.672159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7383): Terminated: ok {rc=0} 07:29:02.718594 --- ParallelTerminationStrategy: PID 7386 died... 07:29:02.737993 run iperf3-srv_10.42.42.10(pid=7386): Terminated {rc=256} 07:29:02.783521 --- ParallelTerminationStrategy: PID 7389 died... 07:29:02.802994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7389): Terminated: ok {rc=0} 07:29:02.848829 --- ParallelTerminationStrategy: PID 7392 died... 07:29:02.868341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7392): Terminated: ok {rc=0} 07:29:02.914665 --- ParallelTerminationStrategy: PID 7395 died... 07:29:02.934289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7395): Terminated: ok {rc=0} 07:29:03.023437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:29:04.172934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.185742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:29:04.260428 tst iperf3m4.py: using LAC 19887 07:29:04.388891 tst iperf3m4.py: using RAC 252 07:29:04.509362 tst iperf3m4.py: using CellId 19887 07:29:04.628659 tst iperf3m4.py: using BVCI 19888 07:29:04.738308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.749593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.760595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.771662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.782516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.793396 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.804300 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.815185 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:04.826990 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:29:04.947611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:29:05.069308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:29:05.190345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:29:05.309945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:29:05.512766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:05.815960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7397): Launched 07:29:06.078474 run iperf3-srv_10.42.42.10(pid=7398): Launched 07:29:06.193714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:29:06.395464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:06.698225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7399): Launched 07:29:06.962853 run iperf3-srv_10.42.42.10(pid=7400): Launched 07:29:07.077520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:29:07.279614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:07.582727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7401): Launched 07:29:07.846772 run iperf3-srv_10.42.42.10(pid=7402): Launched 07:29:07.959589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:29:08.161954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:08.464526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7403): Launched 07:29:08.726711 run iperf3-srv_10.42.42.10(pid=7404): Launched 07:29:08.839303 tst iperf3m4.py:8: start network... 07:29:09.041811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:09.509117 run create_hlr_db(pid=7405): Launched 07:29:09.624019 bus /gobi_6: Setting Powered False 07:29:10.683676 run create_hlr_db(pid=7405): Terminated: ok {rc=0} 07:29:11.104569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7407): Launched 07:29:11.406372 run osmo-hlr_10.42.42.2(pid=7408): Launched 07:29:11.520676 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:12.055033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7410): Launched 07:29:12.356185 run osmo-stp_10.42.42.5(pid=7411): Launched 07:29:12.471004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:12.990340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7413): Launched 07:29:13.105072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:13.359970 run patchelf(pid=7414): Launched 07:29:13.526155 run osmo-stp_10.42.42.5(pid=7411): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7411)] 07:29:13.653771 run osmo-stp_10.42.42.5(pid=7411): stdout: | (launched: 2022-12-09_07:29:12.300311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:13.782709 run osmo-stp_10.42.42.5(pid=7411): stderr: | 20221209072912469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072912469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072912469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072912470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072912470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072912470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072912470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:13.911603 run osmo-stp_10.42.42.5(pid=7411): stdout: | (launched: 2022-12-09_07:29:12.300311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:14.035488 run osmo-stp_10.42.42.5(pid=7411): stderr: | 20221209072912469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072912469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072912469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072912470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072912470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072912470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072912470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:14.182652 run patchelf(pid=7414): Terminating (SIGINT) 07:29:14.351314 run patchelf(pid=7414): Terminated: ok {rc=0} 07:29:14.472543 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7411): Process ended prematurely: osmo-stp_10.42.42.5(pid=7411) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7411)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:29:14.482273 tst iperf3m4.py:8: Test FAILED (10.3 sec) 07:29:14.509552 run osmo-hlr_10.42.42.2(pid=7408): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7408)] 07:29:14.557227 run osmo-hlr_10.42.42.2(pid=7408): stdout: | (launched: 2022-12-09_07:29:11.350858) 07:29:14.607539 run osmo-hlr_10.42.42.2(pid=7408): stderr: | 20221209072911522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072911522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072911522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072911522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072911522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072911522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072911535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072911545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072911545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072911545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:14.657395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7397): Terminating (SIGTERM) 07:29:14.696828 run iperf3-srv_10.42.42.10(pid=7398): Terminating (SIGTERM) 07:29:14.736685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7399): Terminating (SIGTERM) 07:29:14.776794 run iperf3-srv_10.42.42.10(pid=7400): Terminating (SIGTERM) 07:29:14.816534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7401): Terminating (SIGTERM) 07:29:14.856315 run iperf3-srv_10.42.42.10(pid=7402): Terminating (SIGTERM) 07:29:14.895893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7403): Terminating (SIGTERM) 07:29:14.936009 run iperf3-srv_10.42.42.10(pid=7404): Terminating (SIGTERM) 07:29:14.975642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7407): Terminating (SIGTERM) 07:29:15.015868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7410): Terminating (SIGTERM) 07:29:15.055574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7413): Terminating (SIGTERM) 07:29:15.095741 --- ParallelTerminationStrategy: PID 7397 died... 07:29:15.115174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7397): Terminated: ok {rc=0} 07:29:15.159137 --- ParallelTerminationStrategy: PID 7398 died... 07:29:15.177514 run iperf3-srv_10.42.42.10(pid=7398): Terminated {rc=256} 07:29:15.221237 --- ParallelTerminationStrategy: PID 7399 died... 07:29:15.239537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7399): Terminated: ok {rc=0} 07:29:15.283299 --- ParallelTerminationStrategy: PID 7400 died... 07:29:15.301659 run iperf3-srv_10.42.42.10(pid=7400): Terminated {rc=256} 07:29:15.345398 --- ParallelTerminationStrategy: PID 7401 died... 07:29:15.363915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7401): Terminated: ok {rc=0} 07:29:15.407424 --- ParallelTerminationStrategy: PID 7402 died... 07:29:15.425748 run iperf3-srv_10.42.42.10(pid=7402): Terminated {rc=256} 07:29:15.469342 --- ParallelTerminationStrategy: PID 7403 died... 07:29:15.487683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7403): Terminated: ok {rc=0} 07:29:15.531404 --- ParallelTerminationStrategy: PID 7404 died... 07:29:15.549825 run iperf3-srv_10.42.42.10(pid=7404): Terminated {rc=256} 07:29:15.594275 --- ParallelTerminationStrategy: PID 7407 died... 07:29:15.612878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7407): Terminated: ok {rc=0} 07:29:15.656700 --- ParallelTerminationStrategy: PID 7410 died... 07:29:15.675556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7410): Terminated: ok {rc=0} 07:29:15.719406 --- ParallelTerminationStrategy: PID 7413 died... 07:29:15.738146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7413): Terminated: ok {rc=0} 07:29:15.825561 bus /gobi_4: Setting Powered False 07:29:16.937818 bus /gobi_4: Setting Powered False 07:29:18.054864 bus /gobi_1: Setting Powered False 07:29:19.154024 bus /gobi_1: Setting Powered False 07:29:20.269857 bus /gobi_0: Setting Powered False 07:29:21.369029 bus /gobi_0: Setting Powered False 07:29:22.485414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:29:23.589608 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:23.602403 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:29:23.676027 tst ping.py: using LAC 19888 07:29:23.801114 tst ping.py: using RAC 253 07:29:23.931204 tst ping.py: using CellId 19888 07:29:24.054932 tst ping.py: using BVCI 19889 07:29:24.170407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.182201 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.193689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.205090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.216389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.227773 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.239338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:24.250727 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:29:24.370180 tst ping.py:19: start network... 07:29:24.567472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:25.026152 run create_hlr_db(pid=7415): Launched 07:29:25.140548 bus /gobi_6: Setting Powered False 07:29:26.199582 run create_hlr_db(pid=7415): Terminated: ok {rc=0} 07:29:26.634180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7417): Launched 07:29:26.954491 run osmo-hlr_10.42.42.2(pid=7418): Launched 07:29:27.074941 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:27.626001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7420): Launched 07:29:27.943899 run osmo-stp_10.42.42.5(pid=7421): Launched 07:29:28.065226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:28.615501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7423): Launched 07:29:28.736747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:29.005992 run patchelf(pid=7424): Launched 07:29:29.184709 run osmo-stp_10.42.42.5(pid=7421): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7421)] 07:29:29.319093 run osmo-stp_10.42.42.5(pid=7421): stdout: | (launched: 2022-12-09_07:29:27.885225) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:29.455100 run osmo-stp_10.42.42.5(pid=7421): stderr: | 20221209072928073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072928074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072928074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072928074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072928075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072928075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072928075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:29.591035 run osmo-stp_10.42.42.5(pid=7421): stdout: | (launched: 2022-12-09_07:29:27.885225) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:29.723199 run osmo-stp_10.42.42.5(pid=7421): stderr: | 20221209072928073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072928074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072928074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072928074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072928075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072928075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072928075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:29.877359 run patchelf(pid=7424): Terminating (SIGINT) 07:29:30.054842 run patchelf(pid=7424): Terminated: ok {rc=0} 07:29:30.182720 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7421): Process ended prematurely: osmo-stp_10.42.42.5(pid=7421) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7421)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 07:29:30.192288 tst ping.py:22: Test FAILED (6.6 sec) 07:29:30.220311 run osmo-hlr_10.42.42.2(pid=7418): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7418)] 07:29:30.270056 run osmo-hlr_10.42.42.2(pid=7418): stdout: | (launched: 2022-12-09_07:29:26.896471) 07:29:30.321529 run osmo-hlr_10.42.42.2(pid=7418): stderr: | 20221209072927091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072927091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072927091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072927091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072927091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072927091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072927103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072927112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072927112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072927112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:30.372871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7417): Terminating (SIGTERM) 07:29:30.413980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7420): Terminating (SIGTERM) 07:29:30.455411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7423): Terminating (SIGTERM) 07:29:30.497345 --- ParallelTerminationStrategy: PID 7417 died... 07:29:30.517398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7417): Terminated: ok {rc=0} 07:29:30.563654 --- ParallelTerminationStrategy: PID 7420 died... 07:29:30.583357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7420): Terminated: ok {rc=0} 07:29:30.629757 --- ParallelTerminationStrategy: PID 7423 died... 07:29:30.649650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7423): Terminated: ok {rc=0} 07:29:30.738403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:29:31.822108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:31.834999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:29:31.908531 tst ping_idle_ping.py: using LAC 19889 07:29:32.031792 tst ping_idle_ping.py: using RAC 254 07:29:32.179442 tst ping_idle_ping.py: using CellId 19889 07:29:32.306466 tst ping_idle_ping.py: using BVCI 19890 07:29:32.416334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.427584 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.438620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.449554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.460315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.471709 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.482761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:29:32.493633 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:29:32.610891 tst ping_idle_ping.py:24: start network... 07:29:32.810390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:33.280883 run create_hlr_db(pid=7425): Launched 07:29:33.394525 bus /gobi_6: Setting Powered False 07:29:34.453739 run create_hlr_db(pid=7425): Terminated: ok {rc=0} 07:29:34.869438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7427): Launched 07:29:35.166801 run osmo-hlr_10.42.42.2(pid=7428): Launched 07:29:35.280636 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:35.802142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7430): Launched 07:29:36.097281 run osmo-stp_10.42.42.5(pid=7431): Launched 07:29:36.210343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:36.721929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7433): Launched 07:29:36.834521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:37.084163 run patchelf(pid=7434): Launched 07:29:37.249435 run osmo-stp_10.42.42.5(pid=7431): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7431)] 07:29:37.375186 run osmo-stp_10.42.42.5(pid=7431): stdout: | (launched: 2022-12-09_07:29:36.042709) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:37.502331 run osmo-stp_10.42.42.5(pid=7431): stderr: | 20221209072936210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072936210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072936211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072936211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072936212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072936212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072936212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:37.629804 run osmo-stp_10.42.42.5(pid=7431): stdout: | (launched: 2022-12-09_07:29:36.042709) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:37.751580 run osmo-stp_10.42.42.5(pid=7431): stderr: | 20221209072936210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072936210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072936211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072936211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072936212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072936212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072936212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:37.895564 run patchelf(pid=7434): Terminating (SIGINT) 07:29:38.060504 run patchelf(pid=7434): Terminated: ok {rc=0} 07:29:38.179902 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7431): Process ended prematurely: osmo-stp_10.42.42.5(pid=7431) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7431)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:29:38.188898 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:29:38.215705 run osmo-hlr_10.42.42.2(pid=7428): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7428)] 07:29:38.263013 run osmo-hlr_10.42.42.2(pid=7428): stdout: | (launched: 2022-12-09_07:29:35.111611) 07:29:38.312056 run osmo-hlr_10.42.42.2(pid=7428): stderr: | 20221209072935282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072935282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072935282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072935282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072935282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072935282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072935295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072935303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072935304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072935304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:38.361532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7427): Terminating (SIGTERM) 07:29:38.401124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7430): Terminating (SIGTERM) 07:29:38.440640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7433): Terminating (SIGTERM) 07:29:38.480262 --- ParallelTerminationStrategy: PID 7427 died... 07:29:38.499079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7427): Terminated: ok {rc=0} 07:29:38.542829 --- ParallelTerminationStrategy: PID 7430 died... 07:29:38.561167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7430): Terminated: ok {rc=0} 07:29:38.604699 --- ParallelTerminationStrategy: PID 7433 died... 07:29:38.622963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7433): Terminated: ok {rc=0} 07:29:38.707316 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:29:40.015365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:29:40.023095 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:29:40.058470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:29:40.098472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:29:40.189912 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:29:40.225323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:29:40.265066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:29:40.863122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:29:40.915305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:40.927140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:29:41.000624 tst cs_paging_gprs_active.py: using LAC 19890 07:29:41.120506 tst cs_paging_gprs_active.py: using RAC 255 07:29:41.239541 tst cs_paging_gprs_active.py: using CellId 19890 07:29:41.359576 tst cs_paging_gprs_active.py: using BVCI 19891 07:29:41.470526 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.481769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.492612 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.503750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.514888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.525997 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.537204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.548279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:41.559532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:29:41.678915 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:29:41.798008 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:29:42.002295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:42.307575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7438): Launched 07:29:42.570591 run iperf3-srv_10.42.42.10(pid=7439): Launched 07:29:42.684207 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:29:42.887530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:43.192029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7440): Launched 07:29:43.455334 run iperf3-srv_10.42.42.10(pid=7441): Launched 07:29:43.568494 tst cs_paging_gprs_active.py:38: start network... 07:29:43.770271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:44.237601 run create_hlr_db(pid=7442): Launched 07:29:44.351525 bus /gobi_6: Setting Powered False 07:29:45.412643 run create_hlr_db(pid=7442): Terminated: ok {rc=0} 07:29:45.877801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Launched 07:29:46.212060 run osmo-hlr_10.42.42.2(pid=7445): Launched 07:29:46.538462 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:47.219392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Launched 07:29:47.538346 run osmo-stp_10.42.42.5(pid=7448): Launched 07:29:47.657145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:48.177493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7450): Launched 07:29:48.292429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:48.546585 run patchelf(pid=7451): Launched 07:29:48.715079 run osmo-stp_10.42.42.5(pid=7448): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] 07:29:48.842824 run osmo-stp_10.42.42.5(pid=7448): stdout: | (launched: 2022-12-09_07:29:47.482635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:48.971713 run osmo-stp_10.42.42.5(pid=7448): stderr: | 20221209072947649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072947649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072947649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072947650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072947650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072947650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072947650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:49.101228 run osmo-stp_10.42.42.5(pid=7448): stdout: | (launched: 2022-12-09_07:29:47.482635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:49.224504 run osmo-stp_10.42.42.5(pid=7448): stderr: | 20221209072947649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072947649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072947649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072947650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072947650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072947650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072947650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:49.371408 run patchelf(pid=7451): Terminating (SIGINT) 07:29:49.539253 run patchelf(pid=7451): Terminated: ok {rc=0} 07:29:49.660770 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7448): Process ended prematurely: osmo-stp_10.42.42.5(pid=7448) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:29:49.670509 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:29:49.698080 run osmo-hlr_10.42.42.2(pid=7445): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7445)] 07:29:49.745724 run osmo-hlr_10.42.42.2(pid=7445): stdout: | (launched: 2022-12-09_07:29:46.155244) 07:29:49.795225 run osmo-hlr_10.42.42.2(pid=7445): stderr: | 20221209072946511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072946512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072946512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072946512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072946512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072946512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072946536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072946555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072946555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072946557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:49.845736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7438): Terminating (SIGTERM) 07:29:49.885469 run iperf3-srv_10.42.42.10(pid=7439): Terminating (SIGTERM) 07:29:49.924939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7440): Terminating (SIGTERM) 07:29:49.964400 run iperf3-srv_10.42.42.10(pid=7441): Terminating (SIGTERM) 07:29:50.003775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Terminating (SIGTERM) 07:29:50.043427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Terminating (SIGTERM) 07:29:50.083172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7450): Terminating (SIGTERM) 07:29:50.122842 --- ParallelTerminationStrategy: PID 7438 died... 07:29:50.141793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7438): Terminated: ok {rc=0} 07:29:50.185590 --- ParallelTerminationStrategy: PID 7439 died... 07:29:50.203768 run iperf3-srv_10.42.42.10(pid=7439): Terminated {rc=256} 07:29:50.247411 --- ParallelTerminationStrategy: PID 7440 died... 07:29:50.265745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7440): Terminated: ok {rc=0} 07:29:50.309155 --- ParallelTerminationStrategy: PID 7441 died... 07:29:50.327360 run iperf3-srv_10.42.42.10(pid=7441): Terminated {rc=256} 07:29:50.371405 --- ParallelTerminationStrategy: PID 7444 died... 07:29:50.389750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Terminated: ok {rc=0} 07:29:50.433352 --- ParallelTerminationStrategy: PID 7447 died... 07:29:50.451673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Terminated: ok {rc=0} 07:29:50.495827 --- ParallelTerminationStrategy: PID 7450 died... 07:29:50.514198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7450): Terminated: ok {rc=0} 07:29:50.597344 bus /gobi_0: Setting Powered False 07:29:51.694903 bus /gobi_0: Setting Powered False 07:29:52.810308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:29:53.958856 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:53.971153 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:29:54.050823 tst iperf3.py: using LAC 19891 07:29:54.178113 tst iperf3.py: using RAC 1 07:29:54.302524 tst iperf3.py: using CellId 19891 07:29:54.429595 tst iperf3.py: using BVCI 19892 07:29:54.547245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.559047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.570513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.582096 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.593502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.604758 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.616702 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.628049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:54.639619 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:29:54.756798 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:29:54.976416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:55.302887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7452): Launched 07:29:55.586070 run iperf3-srv_10.42.42.10(pid=7453): Launched 07:29:55.709256 tst iperf3.py:8: start network... 07:29:55.928631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:56.433828 run create_hlr_db(pid=7454): Launched 07:29:56.564736 bus /gobi_6: Setting Powered False 07:29:57.629375 run create_hlr_db(pid=7454): Terminated: ok {rc=0} 07:29:58.060353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7456): Launched 07:29:58.364337 run osmo-hlr_10.42.42.2(pid=7457): Launched 07:29:58.478936 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:59.013841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7459): Launched 07:29:59.315085 run osmo-stp_10.42.42.5(pid=7460): Launched 07:29:59.430049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:59.949957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7462): Launched 07:30:00.065417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:00.321654 run patchelf(pid=7463): Launched 07:30:00.489432 run osmo-stp_10.42.42.5(pid=7460): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7460)] 07:30:00.617421 run osmo-stp_10.42.42.5(pid=7460): stdout: | (launched: 2022-12-09_07:29:59.259828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:00.746691 run osmo-stp_10.42.42.5(pid=7460): stderr: | 20221209072959426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072959426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072959426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072959427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072959427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072959427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072959427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:00.893125 run osmo-stp_10.42.42.5(pid=7460): stdout: | (launched: 2022-12-09_07:29:59.259828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:01.035039 run osmo-stp_10.42.42.5(pid=7460): stderr: | 20221209072959426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209072959426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209072959426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209072959427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209072959427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209072959427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209072959427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:01.195562 run patchelf(pid=7463): Terminating (SIGINT) 07:30:01.368627 run patchelf(pid=7463): Terminated: ok {rc=0} 07:30:01.535562 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7460): Process ended prematurely: osmo-stp_10.42.42.5(pid=7460) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7460)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 07:30:01.546359 tst iperf3.py:8: Test FAILED (7.6 sec) 07:30:01.576326 run osmo-hlr_10.42.42.2(pid=7457): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7457)] 07:30:01.627852 run osmo-hlr_10.42.42.2(pid=7457): stdout: | (launched: 2022-12-09_07:29:58.308332) 07:30:01.679910 run osmo-hlr_10.42.42.2(pid=7457): stderr: | 20221209072958480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209072958480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209072958480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209072958480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209072958480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209072958480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209072958495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209072958504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209072958504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209072958504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:01.732910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7452): Terminating (SIGTERM) 07:30:01.775709 run iperf3-srv_10.42.42.10(pid=7453): Terminating (SIGTERM) 07:30:01.820835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7456): Terminating (SIGTERM) 07:30:01.874941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7459): Terminating (SIGTERM) 07:30:01.930515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7462): Terminating (SIGTERM) 07:30:01.981292 --- ParallelTerminationStrategy: PID 7452 died... 07:30:02.001087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7452): Terminated: ok {rc=0} 07:30:02.048613 --- ParallelTerminationStrategy: PID 7453 died... 07:30:02.068273 run iperf3-srv_10.42.42.10(pid=7453): Terminated {rc=256} 07:30:02.115591 --- ParallelTerminationStrategy: PID 7456 died... 07:30:02.135355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7456): Terminated: ok {rc=0} 07:30:02.182885 --- ParallelTerminationStrategy: PID 7459 died... 07:30:02.202657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7459): Terminated: ok {rc=0} 07:30:02.249059 --- ParallelTerminationStrategy: PID 7462 died... 07:30:02.269818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7462): Terminated: ok {rc=0} 07:30:02.358045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:30:03.511108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:03.523873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:30:03.597069 tst iperf3m4.py: using LAC 19892 07:30:03.724890 tst iperf3m4.py: using RAC 2 07:30:03.851881 tst iperf3m4.py: using CellId 19892 07:30:03.979439 tst iperf3m4.py: using BVCI 19893 07:30:04.099000 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.110972 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.122580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.134002 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.145599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.156750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.168552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.180423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:04.192469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:30:04.313288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:30:04.435465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:30:04.554202 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:30:04.672245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:30:04.875788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:05.179921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7467): Launched 07:30:05.443727 run iperf3-srv_10.42.42.10(pid=7468): Launched 07:30:05.557350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:30:05.759970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:06.064308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7469): Launched 07:30:06.327381 run iperf3-srv_10.42.42.10(pid=7470): Launched 07:30:06.440454 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:30:06.643263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:06.947008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7471): Launched 07:30:07.209643 run iperf3-srv_10.42.42.10(pid=7472): Launched 07:30:07.322312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:30:07.524452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:07.827088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7473): Launched 07:30:08.089135 run iperf3-srv_10.42.42.10(pid=7474): Launched 07:30:08.202028 tst iperf3m4.py:8: start network... 07:30:08.404038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:08.870931 run create_hlr_db(pid=7475): Launched 07:30:08.986797 bus /gobi_6: Setting Powered False 07:30:10.046378 run create_hlr_db(pid=7475): Terminated: ok {rc=0} 07:30:10.467489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7477): Launched 07:30:10.769624 run osmo-hlr_10.42.42.2(pid=7478): Launched 07:30:10.895356 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:11.457413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7480): Launched 07:30:11.781903 run osmo-stp_10.42.42.5(pid=7481): Launched 07:30:11.903143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:12.461641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7483): Launched 07:30:12.586093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:12.860778 run patchelf(pid=7484): Launched 07:30:13.041240 run osmo-stp_10.42.42.5(pid=7481): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7481)] 07:30:13.177725 run osmo-stp_10.42.42.5(pid=7481): stdout: | (launched: 2022-12-09_07:30:11.722501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:13.315733 run osmo-stp_10.42.42.5(pid=7481): stderr: | 20221209073011909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073011910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073011910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073011910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073011911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073011911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073011911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:13.454780 run osmo-stp_10.42.42.5(pid=7481): stdout: | (launched: 2022-12-09_07:30:11.722501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:13.587505 run osmo-stp_10.42.42.5(pid=7481): stderr: | 20221209073011909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073011910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073011910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073011910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073011911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073011911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073011911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:13.745259 run patchelf(pid=7484): Terminating (SIGINT) 07:30:13.924887 run patchelf(pid=7484): Terminated: ok {rc=0} 07:30:14.054596 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7481): Process ended prematurely: osmo-stp_10.42.42.5(pid=7481) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7481)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:30:14.064885 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:30:14.093926 run osmo-hlr_10.42.42.2(pid=7478): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7478)] 07:30:14.144417 run osmo-hlr_10.42.42.2(pid=7478): stdout: | (launched: 2022-12-09_07:30:10.714119) 07:30:14.196641 run osmo-hlr_10.42.42.2(pid=7478): stderr: | 20221209073010907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073010907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073010907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073010907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073010907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073010907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073010919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073010928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073010928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073010928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:14.249344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7467): Terminating (SIGTERM) 07:30:14.291608 run iperf3-srv_10.42.42.10(pid=7468): Terminating (SIGTERM) 07:30:14.334018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7469): Terminating (SIGTERM) 07:30:14.376301 run iperf3-srv_10.42.42.10(pid=7470): Terminating (SIGTERM) 07:30:14.418349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7471): Terminating (SIGTERM) 07:30:14.460281 run iperf3-srv_10.42.42.10(pid=7472): Terminating (SIGTERM) 07:30:14.502113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7473): Terminating (SIGTERM) 07:30:14.544030 run iperf3-srv_10.42.42.10(pid=7474): Terminating (SIGTERM) 07:30:14.585737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7477): Terminating (SIGTERM) 07:30:14.627943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7480): Terminating (SIGTERM) 07:30:14.670255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7483): Terminating (SIGTERM) 07:30:14.712340 --- ParallelTerminationStrategy: PID 7467 died... 07:30:14.732496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7467): Terminated: ok {rc=0} 07:30:14.779728 --- ParallelTerminationStrategy: PID 7468 died... 07:30:14.799497 run iperf3-srv_10.42.42.10(pid=7468): Terminated {rc=256} 07:30:14.845171 --- ParallelTerminationStrategy: PID 7469 died... 07:30:14.864827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7469): Terminated: ok {rc=0} 07:30:14.911351 --- ParallelTerminationStrategy: PID 7470 died... 07:30:14.931033 run iperf3-srv_10.42.42.10(pid=7470): Terminated {rc=256} 07:30:14.976739 --- ParallelTerminationStrategy: PID 7471 died... 07:30:14.996396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7471): Terminated: ok {rc=0} 07:30:15.042876 --- ParallelTerminationStrategy: PID 7472 died... 07:30:15.062619 run iperf3-srv_10.42.42.10(pid=7472): Terminated {rc=256} 07:30:15.108477 --- ParallelTerminationStrategy: PID 7473 died... 07:30:15.128018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7473): Terminated: ok {rc=0} 07:30:15.174172 --- ParallelTerminationStrategy: PID 7474 died... 07:30:15.193858 run iperf3-srv_10.42.42.10(pid=7474): Terminated {rc=256} 07:30:15.239630 --- ParallelTerminationStrategy: PID 7477 died... 07:30:15.259381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7477): Terminated: ok {rc=0} 07:30:15.305312 --- ParallelTerminationStrategy: PID 7480 died... 07:30:15.324807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7480): Terminated: ok {rc=0} 07:30:15.371080 --- ParallelTerminationStrategy: PID 7483 died... 07:30:15.390713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7483): Terminated: ok {rc=0} 07:30:15.479143 bus /gobi_4: Setting Powered False 07:30:16.587632 bus /gobi_4: Setting Powered False 07:30:17.712999 bus /gobi_1: Setting Powered False 07:30:18.809503 bus /gobi_1: Setting Powered False 07:30:19.924915 bus /gobi_0: Setting Powered False 07:30:21.022420 bus /gobi_0: Setting Powered False 07:30:22.138672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:30:23.240383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.252282 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:30:23.323884 tst ping.py: using LAC 19893 07:30:23.441970 tst ping.py: using RAC 3 07:30:23.557956 tst ping.py: using CellId 19893 07:30:23.676679 tst ping.py: using BVCI 19894 07:30:23.783949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.795174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.806198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.817810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.828741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.839967 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.851276 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:23.862451 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:30:23.980464 tst ping.py:19: start network... 07:30:24.194585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:24.688122 run create_hlr_db(pid=7485): Launched 07:30:24.816842 bus /gobi_6: Setting Powered False 07:30:25.880287 run create_hlr_db(pid=7485): Terminated: ok {rc=0} 07:30:26.323488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7487): Launched 07:30:26.642451 run osmo-hlr_10.42.42.2(pid=7488): Launched 07:30:26.765632 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:27.325577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7490): Launched 07:30:27.643944 run osmo-stp_10.42.42.5(pid=7491): Launched 07:30:27.766384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:28.277106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7493): Launched 07:30:28.390274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:28.640001 run patchelf(pid=7494): Launched 07:30:28.803773 run osmo-stp_10.42.42.5(pid=7491): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7491)] 07:30:28.928599 run osmo-stp_10.42.42.5(pid=7491): stdout: | (launched: 2022-12-09_07:30:27.585735) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:29.054955 run osmo-stp_10.42.42.5(pid=7491): stderr: | 20221209073027774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073027774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073027774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073027774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073027775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073027775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073027775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:29.181233 run osmo-stp_10.42.42.5(pid=7491): stdout: | (launched: 2022-12-09_07:30:27.585735) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:29.302127 run osmo-stp_10.42.42.5(pid=7491): stderr: | 20221209073027774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073027774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073027774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073027774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073027775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073027775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073027775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:29.445992 run patchelf(pid=7494): Terminating (SIGINT) 07:30:29.611960 run patchelf(pid=7494): Terminated: ok {rc=0} 07:30:29.731487 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7491): Process ended prematurely: osmo-stp_10.42.42.5(pid=7491) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7491)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 07:30:29.740493 tst ping.py:22: Test FAILED (6.5 sec) 07:30:29.767400 run osmo-hlr_10.42.42.2(pid=7488): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7488)] 07:30:29.816163 run osmo-hlr_10.42.42.2(pid=7488): stdout: | (launched: 2022-12-09_07:30:26.583805) 07:30:29.865287 run osmo-hlr_10.42.42.2(pid=7488): stderr: | 20221209073026777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073026777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073026777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073026777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073026777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073026778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073026790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073026801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073026801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073026801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:29.915013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7487): Terminating (SIGTERM) 07:30:29.954316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7490): Terminating (SIGTERM) 07:30:29.994085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7493): Terminating (SIGTERM) 07:30:30.034100 --- ParallelTerminationStrategy: PID 7487 died... 07:30:30.053096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7487): Terminated: ok {rc=0} 07:30:30.097253 --- ParallelTerminationStrategy: PID 7490 died... 07:30:30.115588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7490): Terminated: ok {rc=0} 07:30:30.159360 --- ParallelTerminationStrategy: PID 7493 died... 07:30:30.177697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7493): Terminated: ok {rc=0} 07:30:30.262041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:30:31.356254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:31.373093 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:30:31.462185 tst ping_idle_ping.py: using LAC 19894 07:30:31.584727 tst ping_idle_ping.py: using RAC 4 07:30:31.731534 tst ping_idle_ping.py: using CellId 19894 07:30:31.856174 tst ping_idle_ping.py: using BVCI 19895 07:30:31.994753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.007071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.019090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.031375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.043556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.055614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.067928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:30:32.080075 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:30:32.217323 tst ping_idle_ping.py:24: start network... 07:30:32.433828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:32.931541 run create_hlr_db(pid=7495): Launched 07:30:33.062079 bus /gobi_6: Setting Powered False 07:30:34.125187 run create_hlr_db(pid=7495): Terminated: ok {rc=0} 07:30:34.551549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7497): Launched 07:30:34.849442 run osmo-hlr_10.42.42.2(pid=7498): Launched 07:30:34.962337 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:35.473685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7500): Launched 07:30:35.771326 run osmo-stp_10.42.42.5(pid=7501): Launched 07:30:35.884851 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:36.398541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7503): Launched 07:30:36.511854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:36.762857 run patchelf(pid=7504): Launched 07:30:36.927355 run osmo-stp_10.42.42.5(pid=7501): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7501)] 07:30:37.053757 run osmo-stp_10.42.42.5(pid=7501): stdout: | (launched: 2022-12-09_07:30:35.716580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:37.180552 run osmo-stp_10.42.42.5(pid=7501): stderr: | 20221209073035883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073035883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073035883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073035883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073035884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073035884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073035884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:37.307735 run osmo-stp_10.42.42.5(pid=7501): stdout: | (launched: 2022-12-09_07:30:35.716580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:37.429464 run osmo-stp_10.42.42.5(pid=7501): stderr: | 20221209073035883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073035883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073035883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073035883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073035884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073035884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073035884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:37.574038 run patchelf(pid=7504): Terminating (SIGINT) 07:30:37.741186 run patchelf(pid=7504): Terminated: ok {rc=0} 07:30:37.861442 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7501): Process ended prematurely: osmo-stp_10.42.42.5(pid=7501) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7501)] [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:30:37.870548 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:30:37.897132 run osmo-hlr_10.42.42.2(pid=7498): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7498)] 07:30:37.945144 run osmo-hlr_10.42.42.2(pid=7498): stdout: | (launched: 2022-12-09_07:30:34.794896) 07:30:37.994370 run osmo-hlr_10.42.42.2(pid=7498): stderr: | 20221209073034966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073034966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073034966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073034966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073034966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073034966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073034979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073034987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073034987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073034987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:38.043831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7497): Terminating (SIGTERM) 07:30:38.083497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7500): Terminating (SIGTERM) 07:30:38.123288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7503): Terminating (SIGTERM) 07:30:38.163140 --- ParallelTerminationStrategy: PID 7497 died... 07:30:38.182136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7497): Terminated: ok {rc=0} 07:30:38.226051 --- ParallelTerminationStrategy: PID 7500 died... 07:30:38.244388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7500): Terminated: ok {rc=0} 07:30:38.288482 --- ParallelTerminationStrategy: PID 7503 died... 07:30:38.306874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7503): Terminated: ok {rc=0} 07:30:38.390652 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:30:39.709135 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:39.716885 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:30:39.752727 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:30:39.788677 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:30:39.843029 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:30:39.878094 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:30:39.913755 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:30:40.475723 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:30:40.481213 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:40.493192 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:30:40.568139 tst switch_tch_pdch.py: using LAC 19895 07:30:40.697977 tst switch_tch_pdch.py: using RAC 5 07:30:40.821393 tst switch_tch_pdch.py: using CellId 19895 07:30:40.946261 tst switch_tch_pdch.py: using BVCI 19896 07:30:41.063125 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.074975 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.086535 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.098383 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.110046 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.121648 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.133455 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:30:41.145341 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:30:41.261325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:30:41.379142 tst switch_tch_pdch.py:51: start network... 07:30:41.577029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:42.038237 run create_hlr_db(pid=7508): Launched 07:30:42.152660 bus /gobi_6: Setting Powered False 07:30:43.211740 run create_hlr_db(pid=7508): Terminated: ok {rc=0} 07:30:43.647316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7510): Launched 07:30:43.966409 run osmo-hlr_10.42.42.2(pid=7511): Launched 07:30:44.087227 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:44.631933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7513): Launched 07:30:44.948144 run osmo-stp_10.42.42.5(pid=7514): Launched 07:30:45.069053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:45.615738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7516): Launched 07:30:45.738101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:46.025494 run patchelf(pid=7517): Launched 07:30:46.205824 run osmo-stp_10.42.42.5(pid=7514): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7514)] 07:30:46.337418 run osmo-stp_10.42.42.5(pid=7514): stdout: | (launched: 2022-12-09_07:30:44.890315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:46.472475 run osmo-stp_10.42.42.5(pid=7514): stderr: | 20221209073045078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073045078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073045079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073045079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073045079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073045080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073045080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:46.619350 run osmo-stp_10.42.42.5(pid=7514): stdout: | (launched: 2022-12-09_07:30:44.890315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:46.785197 run osmo-stp_10.42.42.5(pid=7514): stderr: | 20221209073045078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073045078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073045079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073045079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073045079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073045080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073045080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:46.950866 run patchelf(pid=7517): Terminating (SIGINT) 07:30:47.179704 run patchelf(pid=7517): Terminated: ok {rc=0} 07:30:47.316216 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7514): Process ended prematurely: osmo-stp_10.42.42.5(pid=7514) [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7514)] [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:30:47.326474 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 07:30:47.354771 run osmo-hlr_10.42.42.2(pid=7511): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7511)] 07:30:47.405087 run osmo-hlr_10.42.42.2(pid=7511): stdout: | (launched: 2022-12-09_07:30:43.908590) 07:30:47.456858 run osmo-hlr_10.42.42.2(pid=7511): stderr: | 20221209073044102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073044103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073044103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073044103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073044103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073044103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073044115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073044125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073044125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073044125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:47.509114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7510): Terminating (SIGTERM) 07:30:47.550913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7513): Terminating (SIGTERM) 07:30:47.592744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7516): Terminating (SIGTERM) 07:30:47.635338 --- ParallelTerminationStrategy: PID 7510 died... 07:30:47.655435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7510): Terminated: ok {rc=0} 07:30:47.701663 --- ParallelTerminationStrategy: PID 7513 died... 07:30:47.721298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7513): Terminated: ok {rc=0} 07:30:47.767759 --- ParallelTerminationStrategy: PID 7516 died... 07:30:47.787349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7516): Terminated: ok {rc=0} 07:30:47.874783 bus /gobi_0: Setting Powered False 07:30:48.972929 bus /gobi_0: Setting Powered False 07:30:50.089052 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:30:51.344254 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:51.350020 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:30:51.385221 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:30:51.420345 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:30:51.475025 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:30:51.509844 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:30:51.545133 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:30:52.099539 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:30:52.104760 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.116152 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:30:52.191404 tst switch_tch_pdch.py: using LAC 19896 07:30:52.308191 tst switch_tch_pdch.py: using RAC 6 07:30:52.432169 tst switch_tch_pdch.py: using CellId 19896 07:30:52.564319 tst switch_tch_pdch.py: using BVCI 19897 07:30:52.681636 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.693363 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.704826 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.716519 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.727911 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.739313 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.750824 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:30:52.762249 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:30:52.878135 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:30:52.998752 tst switch_tch_pdch.py:51: start network... 07:30:53.212271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:53.677725 run create_hlr_db(pid=7522): Launched 07:30:53.806997 bus /gobi_6: Setting Powered False 07:30:54.869615 run create_hlr_db(pid=7522): Terminated: ok {rc=0} 07:30:55.269373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7524): Launched 07:30:55.587343 run osmo-hlr_10.42.42.2(pid=7525): Launched 07:30:55.708615 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:56.227263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7527): Launched 07:30:56.544049 run osmo-stp_10.42.42.5(pid=7528): Launched 07:30:56.665576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:57.187443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7530): Launched 07:30:57.308456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:57.576770 run patchelf(pid=7531): Launched 07:30:57.753953 run osmo-stp_10.42.42.5(pid=7528): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7528)] 07:30:57.888278 run osmo-stp_10.42.42.5(pid=7528): stdout: | (launched: 2022-12-09_07:30:56.486053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:58.023869 run osmo-stp_10.42.42.5(pid=7528): stderr: | 20221209073056675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073056675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073056675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073056675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073056676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073056676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073056676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:58.160061 run osmo-stp_10.42.42.5(pid=7528): stdout: | (launched: 2022-12-09_07:30:56.486053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:58.290096 run osmo-stp_10.42.42.5(pid=7528): stderr: | 20221209073056675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073056675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073056675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073056675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073056676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073056676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073056676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:58.444190 run patchelf(pid=7531): Terminating (SIGINT) 07:30:58.620767 run patchelf(pid=7531): Terminated: ok {rc=0} 07:30:58.748461 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7528): Process ended prematurely: osmo-stp_10.42.42.5(pid=7528) [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7528)] [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:30:58.758295 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 07:30:58.786206 run osmo-hlr_10.42.42.2(pid=7525): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7525)] 07:30:58.835946 run osmo-hlr_10.42.42.2(pid=7525): stdout: | (launched: 2022-12-09_07:30:55.529421) 07:30:58.887478 run osmo-hlr_10.42.42.2(pid=7525): stderr: | 20221209073055722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073055722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073055722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073055722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073055722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073055723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073055735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073055744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073055744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073055744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:58.939178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7524): Terminating (SIGTERM) 07:30:58.980533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7527): Terminating (SIGTERM) 07:30:59.022119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7530): Terminating (SIGTERM) 07:30:59.063747 --- ParallelTerminationStrategy: PID 7524 died... 07:30:59.083110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7524): Terminated: ok {rc=0} 07:30:59.128880 --- ParallelTerminationStrategy: PID 7527 died... 07:30:59.148349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7527): Terminated: ok {rc=0} 07:30:59.193893 --- ParallelTerminationStrategy: PID 7530 died... 07:30:59.213335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7530): Terminated: ok {rc=0} 07:30:59.300606 bus /gobi_0: Setting Powered False 07:31:00.399712 bus /gobi_0: Setting Powered False 07:31:01.514439 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:trx-umtrx --------------------------------------------------------------------- 07:31:02.772261 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:02.776483 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:31:02.810513 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 07:31:02.817396 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 07:31:02.870361 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:31:02.903259 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 07:31:02.909966 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 07:31:03.447159 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 07:31:03.451915 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 07:31:03.462705 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 07:31:03.509772 tst mo_mt_sms.py: using LAC 19897 07:31:03.627582 tst mo_mt_sms.py: using RAC 7 07:31:03.744152 tst mo_mt_sms.py: using CellId 19897 07:31:03.870219 tst mo_mt_sms.py: using BVCI 19898 07:31:03.985555 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:31:04.104010 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:31:04.221522 tst mo_mt_sms.py:9: start nitb and bts... 07:31:04.437015 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:31:05.086125 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7535): Launched 07:31:05.405760 run osmo-nitb_10.42.42.2(pid=7536): Launched 07:31:05.583450 run osmo-nitb_10.42.42.2(pid=7536): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7536)] 07:31:05.726195 run osmo-nitb_10.42.42.2(pid=7536): stdout: | (launched: 2022-12-09_07:31:05.347870) 07:31:05.870125 run osmo-nitb_10.42.42.2(pid=7536): stderr: | (launched: 2022-12-09_07:31:05.395250) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:31:06.014133 run osmo-nitb_10.42.42.2(pid=7536): stdout: | (launched: 2022-12-09_07:31:05.347870) 07:31:06.152500 run osmo-nitb_10.42.42.2(pid=7536): stderr: | (launched: 2022-12-09_07:31:05.395250) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7536) [trial-2356↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7536)] 07:31:06.527298 tst osmo-nitb_10.42.42.2(pid=7536): stdout: | (launched: 2022-12-09_07:31:05.347870) 07:31:06.655570 tst osmo-nitb_10.42.42.2(pid=7536): stderr: | (launched: 2022-12-09_07:31:05.395250) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:31:06.806535 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7536) [trial-2356↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7536)] [trial-2356↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 07:31:06.815598 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:31:06.822499 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7535): Terminating (SIGTERM) 07:31:07.032297 --- ParallelTerminationStrategy: PID 7535 died... 07:31:07.053488 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7535): Terminated: ok {rc=0} 07:31:07.139852 bus /sierra_3: Setting Powered False 07:31:08.239316 bus /sierra_3: Setting Powered False 07:31:09.354066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:trx-umtrx --------------------------------------------------------------------- 07:31:10.556252 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:10.560602 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:31:10.594398 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:31:10.622126 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 07:31:10.675471 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:31:10.709452 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:31:10.737346 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 07:31:11.285671 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 07:31:11.290634 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:11.301758 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 07:31:11.349637 tst mo_mt_sms.py: using LAC 19898 07:31:11.476329 tst mo_mt_sms.py: using RAC 8 07:31:11.601719 tst mo_mt_sms.py: using CellId 19898 07:31:11.728365 tst mo_mt_sms.py: using BVCI 19899 07:31:11.843513 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:11.854570 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:11.865610 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:11.876449 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:11.887508 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:11.898499 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:31:12.012909 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:31:12.132660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:12.626698 run create_hlr_db(pid=7541): Launched 07:31:12.755691 bus /sierra_2: Setting Powered False 07:31:13.818213 run create_hlr_db(pid=7541): Terminated: ok {rc=0} 07:31:14.260124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7543): Launched 07:31:14.576684 run osmo-hlr_10.42.42.2(pid=7544): Launched 07:31:14.698698 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:15.252315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7546): Launched 07:31:15.570554 run osmo-stp_10.42.42.5(pid=7547): Launched 07:31:15.692114 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:16.297589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7549): Launched 07:31:16.613695 run osmo-msc_10.42.42.6(pid=7550): Launched 07:31:16.946414 run osmo-stp_10.42.42.5(pid=7547): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7547)] 07:31:17.147331 run osmo-stp_10.42.42.5(pid=7547): stdout: | (launched: 2022-12-09_07:31:15.511963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:17.365809 run osmo-stp_10.42.42.5(pid=7547): stderr: | 20221209073115698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073115698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073115698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073115699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073115699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073115699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073115699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:17.490659 run osmo-stp_10.42.42.5(pid=7547): stdout: | (launched: 2022-12-09_07:31:15.511963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:17.609480 run osmo-stp_10.42.42.5(pid=7547): stderr: | 20221209073115698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073115698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073115698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073115699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073115699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073115699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073115699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:17.750945 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7547): Process ended prematurely: osmo-stp_10.42.42.5(pid=7547) [trial-2356↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7547)] [trial-2356↪sms:trx-umtrx↪mo_mt_sms.py:16] 07:31:17.759579 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 07:31:17.785953 run osmo-hlr_10.42.42.2(pid=7544): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7544)] 07:31:17.834263 run osmo-hlr_10.42.42.2(pid=7544): stdout: | (launched: 2022-12-09_07:31:14.518585) 07:31:17.883910 run osmo-hlr_10.42.42.2(pid=7544): stderr: | 20221209073114711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073114711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073114711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073114711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073114711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073114711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073114723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073114732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073114732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073114732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:17.952776 run osmo-msc_10.42.42.6(pid=7550): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7550)] 07:31:18.000717 run osmo-msc_10.42.42.6(pid=7550): stdout: | (launched: 2022-12-09_07:31:16.555086) 07:31:18.049987 run osmo-msc_10.42.42.6(pid=7550): stderr: | 20221209073117050 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073117050 DLGLOBAL DEBUG validating counter group 0x7f38ac837c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073117050 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073117050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073117051 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073117051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073117052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073117053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073117053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073117053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:18.099454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7543): Terminating (SIGTERM) 07:31:18.139229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7546): Terminating (SIGTERM) 07:31:18.179042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7549): Terminating (SIGTERM) 07:31:18.219206 --- ParallelTerminationStrategy: PID 7543 died... 07:31:18.238095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7543): Terminated: ok {rc=0} 07:31:18.282346 --- ParallelTerminationStrategy: PID 7546 died... 07:31:18.300568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7546): Terminated: ok {rc=0} 07:31:18.345208 --- ParallelTerminationStrategy: PID 7549 died... 07:31:18.363596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7549): Terminated: ok {rc=0} 07:31:18.448912 bus /sierra_3: Setting Powered False 07:31:19.547398 bus /sierra_3: Setting Powered False 07:31:20.659326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 07:31:21.894467 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:21.898516 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:31:21.932398 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 07:31:21.939513 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 07:31:21.975393 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:31:22.009861 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 07:31:22.017041 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 07:31:22.537648 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 07:31:22.542692 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 07:31:22.553961 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 07:31:22.602660 tst assert_extension.py: using LAC 19899 07:31:22.729379 tst assert_extension.py: using RAC 9 07:31:22.853631 tst assert_extension.py: using CellId 19899 07:31:22.977376 tst assert_extension.py: using BVCI 19900 07:31:23.091808 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 07:31:23.206251 tst assert_extension.py:10: start nitb and bts... 07:31:23.406206 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:31:24.015665 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7555): Launched 07:31:24.312371 run osmo-nitb_10.42.42.2(pid=7556): Launched 07:31:24.477191 run osmo-nitb_10.42.42.2(pid=7556): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7556)] 07:31:24.610794 run osmo-nitb_10.42.42.2(pid=7556): stdout: | (launched: 2022-12-09_07:31:24.258113) 07:31:24.745771 run osmo-nitb_10.42.42.2(pid=7556): stderr: | (launched: 2022-12-09_07:31:24.302063) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:31:24.881327 run osmo-nitb_10.42.42.2(pid=7556): stdout: | (launched: 2022-12-09_07:31:24.258113) 07:31:25.010813 run osmo-nitb_10.42.42.2(pid=7556): stderr: | (launched: 2022-12-09_07:31:24.302063) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7556): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7556) [trial-2356↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7556)] 07:31:25.424851 tst osmo-nitb_10.42.42.2(pid=7556): stdout: | (launched: 2022-12-09_07:31:24.258113) 07:31:25.544250 tst osmo-nitb_10.42.42.2(pid=7556): stderr: | (launched: 2022-12-09_07:31:24.302063) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:31:25.684826 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7556): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7556) [trial-2356↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7556)] [trial-2356↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 07:31:25.693605 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:31:25.700333 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7555): Terminating (SIGTERM) 07:31:25.909515 --- ParallelTerminationStrategy: PID 7555 died... 07:31:25.929817 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7555): Terminated: ok {rc=0} 07:31:26.015105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:trx-umtrx --------------------------------------------------------------------- 07:31:27.194106 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:27.198630 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:31:27.233824 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:31:27.262084 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 07:31:27.299107 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:31:27.333125 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:31:27.360421 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 07:31:27.889277 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 07:31:27.895221 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:27.906855 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 07:31:27.959287 tst assert_extension.py: using LAC 19900 07:31:28.084375 tst assert_extension.py: using RAC 10 07:31:28.209601 tst assert_extension.py: using CellId 19900 07:31:28.332594 tst assert_extension.py: using BVCI 19901 07:31:28.449546 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:28.460561 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:28.471582 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:28.482509 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:28.493574 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:31:28.504394 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 07:31:28.620124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:29.078322 run create_hlr_db(pid=7560): Launched 07:31:29.191479 bus /sierra_2: Setting Powered False 07:31:30.250981 run create_hlr_db(pid=7560): Terminated: ok {rc=0} 07:31:30.665216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7562): Launched 07:31:30.975910 run osmo-hlr_10.42.42.2(pid=7563): Launched 07:31:31.265713 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:31.856189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7565): Launched 07:31:32.174063 run osmo-stp_10.42.42.5(pid=7566): Launched 07:31:32.388331 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:32.936097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7568): Launched 07:31:33.231409 run osmo-msc_10.42.42.6(pid=7569): Launched 07:31:33.397847 run osmo-stp_10.42.42.5(pid=7566): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7566)] 07:31:33.523810 run osmo-stp_10.42.42.5(pid=7566): stdout: | (launched: 2022-12-09_07:31:32.117398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:33.650667 run osmo-stp_10.42.42.5(pid=7566): stderr: | 20221209073132375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073132375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073132375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073132376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073132376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073132376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073132376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:33.774846 run osmo-stp_10.42.42.5(pid=7566): stdout: | (launched: 2022-12-09_07:31:32.117398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:33.892738 run osmo-stp_10.42.42.5(pid=7566): stderr: | 20221209073132375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073132375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073132375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073132376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073132376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073132376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073132376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:34.034123 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7566): Process ended prematurely: osmo-stp_10.42.42.5(pid=7566) [trial-2356↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7566)] [trial-2356↪ussd:trx-umtrx↪assert_extension.py:17] 07:31:34.042676 tst assert_extension.py:17: Test FAILED (6.1 sec) 07:31:34.068824 run osmo-hlr_10.42.42.2(pid=7563): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7563)] 07:31:34.117068 run osmo-hlr_10.42.42.2(pid=7563): stdout: | (launched: 2022-12-09_07:31:30.920396) 07:31:34.166574 run osmo-hlr_10.42.42.2(pid=7563): stderr: | 20221209073131158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073131158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073131158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073131158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073131158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073131158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073131175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073131191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073131192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073131192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:34.235261 run osmo-msc_10.42.42.6(pid=7569): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7569)] 07:31:34.282644 run osmo-msc_10.42.42.6(pid=7569): stdout: | (launched: 2022-12-09_07:31:33.176359) 07:31:34.331751 run osmo-msc_10.42.42.6(pid=7569): stderr: | 20221209073133444 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073133444 DLGLOBAL DEBUG validating counter group 0x7f91df7a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073133445 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073133445 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073133445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073133445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073133447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073133447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073133447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073133447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:34.381959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7562): Terminating (SIGTERM) 07:31:34.421409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7565): Terminating (SIGTERM) 07:31:34.460902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7568): Terminating (SIGTERM) 07:31:34.500803 --- ParallelTerminationStrategy: PID 7562 died... 07:31:34.519729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7562): Terminated: ok {rc=0} 07:31:34.563884 --- ParallelTerminationStrategy: PID 7565 died... 07:31:34.582417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7565): Terminated: ok {rc=0} 07:31:34.626412 --- ParallelTerminationStrategy: PID 7568 died... 07:31:34.645009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7568): Terminated: ok {rc=0} 07:31:34.728206 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:31:35.939958 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:35.947074 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:31:35.980849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:31:36.008694 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:31:36.062595 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:31:36.096646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:31:36.124721 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:31:36.677939 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:31:36.730151 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:36.741805 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:31:36.813442 tst mo_mt_call.py: using LAC 19901 07:31:36.941124 tst mo_mt_call.py: using RAC 11 07:31:37.070627 tst mo_mt_call.py: using CellId 19901 07:31:37.197019 tst mo_mt_call.py: using BVCI 19902 07:31:37.314074 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:37.325708 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:37.337190 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:37.348620 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:37.360135 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:37.371559 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:31:37.487192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:31:37.605329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:38.072769 run create_hlr_db(pid=7574): Launched 07:31:38.188676 bus /sierra_2: Setting Powered False 07:31:39.249254 run create_hlr_db(pid=7574): Terminated: ok {rc=0} 07:31:39.691942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7576): Launched 07:31:40.016326 run osmo-hlr_10.42.42.2(pid=7577): Launched 07:31:40.140176 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:40.697405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7579): Launched 07:31:41.020933 run osmo-stp_10.42.42.5(pid=7580): Launched 07:31:41.144879 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:41.731234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7582): Launched 07:31:42.054299 run osmo-msc_10.42.42.6(pid=7583): Launched 07:31:42.236405 run osmo-stp_10.42.42.5(pid=7580): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7580)] 07:31:42.372546 run osmo-stp_10.42.42.5(pid=7580): stdout: | (launched: 2022-12-09_07:31:40.962220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:42.509245 run osmo-stp_10.42.42.5(pid=7580): stderr: | 20221209073141149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073141149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073141150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073141150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073141151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073141151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073141151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:42.643857 run osmo-stp_10.42.42.5(pid=7580): stdout: | (launched: 2022-12-09_07:31:40.962220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:42.774023 run osmo-stp_10.42.42.5(pid=7580): stderr: | 20221209073141149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073141149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073141150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073141150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073141151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073141151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073141151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:42.928112 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7580): Process ended prematurely: osmo-stp_10.42.42.5(pid=7580) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7580)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:31:42.937966 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:31:42.965454 run osmo-hlr_10.42.42.2(pid=7577): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7577)] 07:31:43.015574 run osmo-hlr_10.42.42.2(pid=7577): stdout: | (launched: 2022-12-09_07:31:39.956898) 07:31:43.067132 run osmo-hlr_10.42.42.2(pid=7577): stderr: | 20221209073140151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073140151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073140151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073140151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073140151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073140152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073140164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073140175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073140176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073140176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:43.138997 run osmo-msc_10.42.42.6(pid=7583): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7583)] 07:31:43.188865 run osmo-msc_10.42.42.6(pid=7583): stdout: | (launched: 2022-12-09_07:31:41.995598) 07:31:43.240373 run osmo-msc_10.42.42.6(pid=7583): stderr: | 20221209073142315 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073142315 DLGLOBAL DEBUG validating counter group 0x7f5c820c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073142315 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073142315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073142315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073142315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073142317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073142318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073142318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073142318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:43.291949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7576): Terminating (SIGTERM) 07:31:43.333605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7579): Terminating (SIGTERM) 07:31:43.375211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7582): Terminating (SIGTERM) 07:31:43.416852 --- ParallelTerminationStrategy: PID 7576 died... 07:31:43.436715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7576): Terminated: ok {rc=0} 07:31:43.482655 --- ParallelTerminationStrategy: PID 7579 died... 07:31:43.501978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7579): Terminated: ok {rc=0} 07:31:43.547688 --- ParallelTerminationStrategy: PID 7582 died... 07:31:43.567104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7582): Terminated: ok {rc=0} 07:31:43.654362 bus /sierra_3: Setting Powered False 07:31:44.754531 bus /sierra_3: Setting Powered False 07:31:45.873419 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:31:47.059832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:47.074372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:31:47.147153 tst mo_mt_call_osmux.py: using LAC 19902 07:31:47.282212 tst mo_mt_call_osmux.py: using RAC 12 07:31:47.409000 tst mo_mt_call_osmux.py: using CellId 19902 07:31:47.533998 tst mo_mt_call_osmux.py: using BVCI 19903 07:31:47.644809 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:47.656202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:47.667698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:47.679089 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:47.690622 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:31:47.702071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:31:47.818220 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:31:47.935355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:48.405250 run create_hlr_db(pid=7585): Launched 07:31:48.519808 bus /sierra_2: Setting Powered False 07:31:49.580168 run create_hlr_db(pid=7585): Terminated: ok {rc=0} 07:31:50.021452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7587): Launched 07:31:50.344422 run osmo-hlr_10.42.42.2(pid=7588): Launched 07:31:50.466195 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:51.025015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7590): Launched 07:31:51.347585 run osmo-stp_10.42.42.5(pid=7591): Launched 07:31:51.470774 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:52.057632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7593): Launched 07:31:52.381628 run osmo-msc_10.42.42.6(pid=7594): Launched 07:31:52.562985 run osmo-stp_10.42.42.5(pid=7591): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7591)] 07:31:52.699421 run osmo-stp_10.42.42.5(pid=7591): stdout: | (launched: 2022-12-09_07:31:51.288506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:52.835725 run osmo-stp_10.42.42.5(pid=7591): stderr: | 20221209073151476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073151476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073151477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073151477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073151478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073151478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073151478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:52.970703 run osmo-stp_10.42.42.5(pid=7591): stdout: | (launched: 2022-12-09_07:31:51.288506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:53.100548 run osmo-stp_10.42.42.5(pid=7591): stderr: | 20221209073151476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073151476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073151477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073151477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073151478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073151478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073151478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:53.255096 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7591): Process ended prematurely: osmo-stp_10.42.42.5(pid=7591) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7591)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:31:53.264652 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:31:53.292400 run osmo-hlr_10.42.42.2(pid=7588): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7588)] 07:31:53.342189 run osmo-hlr_10.42.42.2(pid=7588): stdout: | (launched: 2022-12-09_07:31:50.285635) 07:31:53.393582 run osmo-hlr_10.42.42.2(pid=7588): stderr: | 20221209073150482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073150482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073150482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073150482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073150482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073150482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073150494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073150503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073150503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073150503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:53.465205 run osmo-msc_10.42.42.6(pid=7594): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7594)] 07:31:53.514860 run osmo-msc_10.42.42.6(pid=7594): stdout: | (launched: 2022-12-09_07:31:52.322562) 07:31:53.566501 run osmo-msc_10.42.42.6(pid=7594): stderr: | 20221209073152641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073152641 DLGLOBAL DEBUG validating counter group 0x7fafcfab8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073152641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073152641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073152641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073152641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073152643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073152643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073152644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073152644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:53.618034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7587): Terminating (SIGTERM) 07:31:53.659392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7590): Terminating (SIGTERM) 07:31:53.701216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7593): Terminating (SIGTERM) 07:31:53.743784 --- ParallelTerminationStrategy: PID 7587 died... 07:31:53.763988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7587): Terminated: ok {rc=0} 07:31:53.810356 --- ParallelTerminationStrategy: PID 7590 died... 07:31:53.829837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7590): Terminated: ok {rc=0} 07:31:53.875764 --- ParallelTerminationStrategy: PID 7593 died... 07:31:53.895244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7593): Terminated: ok {rc=0} 07:31:53.982615 bus /sierra_3: Setting Powered False 07:31:55.080605 bus /sierra_3: Setting Powered False 07:31:56.194323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:31:57.450328 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:57.457322 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:31:57.491325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:31:57.519087 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:31:57.574367 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:31:57.608585 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:31:57.636251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:31:58.187885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:31:58.239560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:31:58.251267 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:31:58.324924 tst mo_mt_call.py: using LAC 19903 07:31:58.450387 tst mo_mt_call.py: using RAC 13 07:31:58.574486 tst mo_mt_call.py: using CellId 19903 07:31:58.699536 tst mo_mt_call.py: using BVCI 19904 07:31:58.818088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:31:58.829693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:31:58.841085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:31:58.852449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:31:58.863963 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:31:58.875458 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:31:58.994385 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:31:59.110495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:59.579990 run create_hlr_db(pid=7599): Launched 07:31:59.696126 bus /sierra_2: Setting Powered False 07:32:00.755683 run create_hlr_db(pid=7599): Terminated: ok {rc=0} 07:32:01.261948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7601): Launched 07:32:01.576121 run osmo-hlr_10.42.42.2(pid=7602): Launched 07:32:01.828382 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:02.528132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7604): Launched 07:32:02.828901 run osmo-stp_10.42.42.5(pid=7605): Launched 07:32:02.943273 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:03.487878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7607): Launched 07:32:03.788517 run osmo-msc_10.42.42.6(pid=7608): Launched 07:32:03.955796 run osmo-stp_10.42.42.5(pid=7605): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7605)] 07:32:04.083551 run osmo-stp_10.42.42.5(pid=7605): stdout: | (launched: 2022-12-09_07:32:02.773949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:04.210653 run osmo-stp_10.42.42.5(pid=7605): stderr: | 20221209073202939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073202939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073202940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073202940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073202940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073202941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073202941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:04.336198 run osmo-stp_10.42.42.5(pid=7605): stdout: | (launched: 2022-12-09_07:32:02.773949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:04.457282 run osmo-stp_10.42.42.5(pid=7605): stderr: | 20221209073202939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073202939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073202940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073202940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073202940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073202941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073202941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:04.600414 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7605): Process ended prematurely: osmo-stp_10.42.42.5(pid=7605) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7605)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:32:04.609570 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:32:04.636416 run osmo-hlr_10.42.42.2(pid=7602): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7602)] 07:32:04.683922 run osmo-hlr_10.42.42.2(pid=7602): stdout: | (launched: 2022-12-09_07:32:01.519159) 07:32:04.733148 run osmo-hlr_10.42.42.2(pid=7602): stderr: | 20221209073201873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073201873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073201873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073201873 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073201873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073201873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073201897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073201914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073201914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073201914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:04.801475 run osmo-msc_10.42.42.6(pid=7608): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7608)] 07:32:04.848920 run osmo-msc_10.42.42.6(pid=7608): stdout: | (launched: 2022-12-09_07:32:03.733355) 07:32:04.898033 run osmo-msc_10.42.42.6(pid=7608): stderr: | 20221209073204003 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073204003 DLGLOBAL DEBUG validating counter group 0x7f99fe9b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073204003 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073204004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073204004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073204004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073204006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073204006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073204006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073204006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:04.947397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7601): Terminating (SIGTERM) 07:32:04.986582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7604): Terminating (SIGTERM) 07:32:05.026313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7607): Terminating (SIGTERM) 07:32:05.066071 --- ParallelTerminationStrategy: PID 7601 died... 07:32:05.084997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7601): Terminated: ok {rc=0} 07:32:05.129288 --- ParallelTerminationStrategy: PID 7604 died... 07:32:05.147903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7604): Terminated: ok {rc=0} 07:32:05.192125 --- ParallelTerminationStrategy: PID 7607 died... 07:32:05.210874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7607): Terminated: ok {rc=0} 07:32:05.296475 bus /sierra_3: Setting Powered False 07:32:06.393702 bus /sierra_3: Setting Powered False 07:32:07.508619 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:32:08.653887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:32:08.666098 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:32:08.736121 tst mo_mt_call_osmux.py: using LAC 19904 07:32:08.854567 tst mo_mt_call_osmux.py: using RAC 14 07:32:08.972260 tst mo_mt_call_osmux.py: using CellId 19904 07:32:09.090121 tst mo_mt_call_osmux.py: using BVCI 19905 07:32:09.201795 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:32:09.213096 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:32:09.224086 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:32:09.234999 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:32:09.246498 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:32:09.257747 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:32:09.378508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:32:09.505542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:10.009432 run create_hlr_db(pid=7610): Launched 07:32:10.140880 bus /sierra_2: Setting Powered False 07:32:11.205225 run create_hlr_db(pid=7610): Terminated: ok {rc=0} 07:32:11.637170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7612): Launched 07:32:11.962496 run osmo-hlr_10.42.42.2(pid=7613): Launched 07:32:12.084413 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:12.646271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7615): Launched 07:32:12.970880 run osmo-stp_10.42.42.5(pid=7616): Launched 07:32:13.093967 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:13.678295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7618): Launched 07:32:14.003442 run osmo-msc_10.42.42.6(pid=7619): Launched 07:32:14.183454 run osmo-stp_10.42.42.5(pid=7616): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7616)] 07:32:14.318921 run osmo-stp_10.42.42.5(pid=7616): stdout: | (launched: 2022-12-09_07:32:12.912018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:14.455311 run osmo-stp_10.42.42.5(pid=7616): stderr: | 20221209073213100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073213101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073213101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073213101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073213102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073213102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073213102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:14.590005 run osmo-stp_10.42.42.5(pid=7616): stdout: | (launched: 2022-12-09_07:32:12.912018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:14.719262 run osmo-stp_10.42.42.5(pid=7616): stderr: | 20221209073213100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073213101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073213101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073213101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073213102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073213102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073213102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:14.873556 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7616): Process ended prematurely: osmo-stp_10.42.42.5(pid=7616) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7616)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:32:14.883140 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:32:14.910624 run osmo-hlr_10.42.42.2(pid=7613): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7613)] 07:32:14.960053 run osmo-hlr_10.42.42.2(pid=7613): stdout: | (launched: 2022-12-09_07:32:11.903471) 07:32:15.011252 run osmo-hlr_10.42.42.2(pid=7613): stderr: | 20221209073212098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073212098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073212098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073212098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073212098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073212098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073212111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073212119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073212119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073212119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:15.082545 run osmo-msc_10.42.42.6(pid=7619): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7619)] 07:32:15.132180 run osmo-msc_10.42.42.6(pid=7619): stdout: | (launched: 2022-12-09_07:32:13.944230) 07:32:15.183243 run osmo-msc_10.42.42.6(pid=7619): stderr: | 20221209073214264 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073214264 DLGLOBAL DEBUG validating counter group 0x7eff6b447c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073214265 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073214265 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073214265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073214265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073214267 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073214267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073214267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073214267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:15.234715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7612): Terminating (SIGTERM) 07:32:15.276039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7615): Terminating (SIGTERM) 07:32:15.317360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7618): Terminating (SIGTERM) 07:32:15.358741 --- ParallelTerminationStrategy: PID 7612 died... 07:32:15.378400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7612): Terminated: ok {rc=0} 07:32:15.423983 --- ParallelTerminationStrategy: PID 7615 died... 07:32:15.443187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7615): Terminated: ok {rc=0} 07:32:15.488735 --- ParallelTerminationStrategy: PID 7618 died... 07:32:15.508731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7618): Terminated: ok {rc=0} 07:32:15.596896 bus /sierra_3: Setting Powered False 07:32:16.703673 bus /sierra_3: Setting Powered False 07:32:17.828210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:32:19.083000 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:19.090444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:32:19.124318 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:32:19.152022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:32:19.206027 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:32:19.240184 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:32:19.267866 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:32:19.819765 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:32:19.871157 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:19.882820 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:32:19.953468 tst mo_mt_call.py: using LAC 19905 07:32:20.083258 tst mo_mt_call.py: using RAC 15 07:32:20.209653 tst mo_mt_call.py: using CellId 19905 07:32:20.334493 tst mo_mt_call.py: using BVCI 19906 07:32:20.452317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:20.464195 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:20.475684 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:20.487225 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:20.498856 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:20.510302 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:32:20.627921 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:32:20.744768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:21.213771 run create_hlr_db(pid=7631): Launched 07:32:21.329215 bus /sierra_2: Setting Powered False 07:32:22.387761 run create_hlr_db(pid=7631): Terminated: ok {rc=0} 07:32:22.808649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Launched 07:32:23.111387 run osmo-hlr_10.42.42.2(pid=7634): Launched 07:32:23.226304 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:23.759588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Launched 07:32:24.062239 run osmo-stp_10.42.42.5(pid=7637): Launched 07:32:24.177697 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:24.725324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7639): Launched 07:32:25.029536 run osmo-msc_10.42.42.6(pid=7640): Launched 07:32:25.198556 run osmo-stp_10.42.42.5(pid=7637): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] 07:32:25.327235 run osmo-stp_10.42.42.5(pid=7637): stdout: | (launched: 2022-12-09_07:32:24.006408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:25.455272 run osmo-stp_10.42.42.5(pid=7637): stderr: | 20221209073224172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073224173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073224173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073224173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073224174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073224174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073224174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:25.581117 run osmo-stp_10.42.42.5(pid=7637): stdout: | (launched: 2022-12-09_07:32:24.006408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:25.701345 run osmo-stp_10.42.42.5(pid=7637): stderr: | 20221209073224172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073224173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073224173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073224173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073224174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073224174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073224174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:25.844797 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7637): Process ended prematurely: osmo-stp_10.42.42.5(pid=7637) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:32:25.853795 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:32:25.880222 run osmo-hlr_10.42.42.2(pid=7634): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7634)] 07:32:25.927894 run osmo-hlr_10.42.42.2(pid=7634): stdout: | (launched: 2022-12-09_07:32:23.055877) 07:32:25.977130 run osmo-hlr_10.42.42.2(pid=7634): stderr: | 20221209073223227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073223227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073223227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073223227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073223227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073223227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073223239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073223247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073223247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073223247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:26.046219 run osmo-msc_10.42.42.6(pid=7640): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7640)] 07:32:26.093617 run osmo-msc_10.42.42.6(pid=7640): stdout: | (launched: 2022-12-09_07:32:24.973299) 07:32:26.142691 run osmo-msc_10.42.42.6(pid=7640): stderr: | 20221209073225243 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073225243 DLGLOBAL DEBUG validating counter group 0x7fe922fd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073225244 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073225244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073225244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073225244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073225246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073225246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073225246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073225246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:26.192015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Terminating (SIGTERM) 07:32:26.231184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminating (SIGTERM) 07:32:26.270897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7639): Terminating (SIGTERM) 07:32:26.310788 --- ParallelTerminationStrategy: PID 7633 died... 07:32:26.329513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Terminated: ok {rc=0} 07:32:26.373283 --- ParallelTerminationStrategy: PID 7636 died... 07:32:26.391630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminated: ok {rc=0} 07:32:26.435183 --- ParallelTerminationStrategy: PID 7639 died... 07:32:26.453453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7639): Terminated: ok {rc=0} 07:32:26.536727 bus /sierra_3: Setting Powered False 07:32:27.631553 bus /sierra_3: Setting Powered False 07:32:28.746585 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:32:29.891130 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:29.903105 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:32:29.972882 tst mo_mt_call_osmux.py: using LAC 19906 07:32:30.092525 tst mo_mt_call_osmux.py: using RAC 16 07:32:30.210371 tst mo_mt_call_osmux.py: using CellId 19906 07:32:30.330200 tst mo_mt_call_osmux.py: using BVCI 19907 07:32:30.441572 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:30.452643 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:30.463680 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:30.474973 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:30.486323 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:32:30.497871 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:32:30.612501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:32:30.735422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:31.235638 run create_hlr_db(pid=7642): Launched 07:32:31.419239 bus /sierra_2: Setting Powered False 07:32:32.479795 run create_hlr_db(pid=7642): Terminated: ok {rc=0} 07:32:32.971434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7644): Launched 07:32:33.297861 run osmo-hlr_10.42.42.2(pid=7645): Launched 07:32:33.422223 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:33.980421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7647): Launched 07:32:34.303957 run osmo-stp_10.42.42.5(pid=7648): Launched 07:32:34.426796 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:35.013444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7650): Launched 07:32:35.336549 run osmo-msc_10.42.42.6(pid=7651): Launched 07:32:35.516378 run osmo-stp_10.42.42.5(pid=7648): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7648)] 07:32:35.653280 run osmo-stp_10.42.42.5(pid=7648): stdout: | (launched: 2022-12-09_07:32:34.244926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:35.792044 run osmo-stp_10.42.42.5(pid=7648): stderr: | 20221209073234433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073234433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073234433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073234433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073234434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073234434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073234434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:35.929464 run osmo-stp_10.42.42.5(pid=7648): stdout: | (launched: 2022-12-09_07:32:34.244926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:36.058459 run osmo-stp_10.42.42.5(pid=7648): stderr: | 20221209073234433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073234433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073234433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073234433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073234434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073234434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073234434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:36.212737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7648): Process ended prematurely: osmo-stp_10.42.42.5(pid=7648) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7648)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:32:36.222325 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:32:36.250027 run osmo-hlr_10.42.42.2(pid=7645): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7645)] 07:32:36.299866 run osmo-hlr_10.42.42.2(pid=7645): stdout: | (launched: 2022-12-09_07:32:33.238750) 07:32:36.351283 run osmo-hlr_10.42.42.2(pid=7645): stderr: | 20221209073233433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073233433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073233433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073233433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073233433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073233433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073233445 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073233454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073233454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073233455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:36.422914 run osmo-msc_10.42.42.6(pid=7651): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7651)] 07:32:36.472823 run osmo-msc_10.42.42.6(pid=7651): stdout: | (launched: 2022-12-09_07:32:35.277088) 07:32:36.524199 run osmo-msc_10.42.42.6(pid=7651): stderr: | 20221209073235598 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073235598 DLGLOBAL DEBUG validating counter group 0x7f2d97650c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073235598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073235598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073235598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073235598 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073235600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073235600 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073235601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073235601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:36.575860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7644): Terminating (SIGTERM) 07:32:36.617231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7647): Terminating (SIGTERM) 07:32:36.658590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7650): Terminating (SIGTERM) 07:32:36.700506 --- ParallelTerminationStrategy: PID 7644 died... 07:32:36.720551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7644): Terminated: ok {rc=0} 07:32:36.766435 --- ParallelTerminationStrategy: PID 7647 died... 07:32:36.785991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7647): Terminated: ok {rc=0} 07:32:36.832179 --- ParallelTerminationStrategy: PID 7650 died... 07:32:36.851552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7650): Terminated: ok {rc=0} 07:32:36.938654 bus /sierra_3: Setting Powered False 07:32:38.036546 bus /sierra_3: Setting Powered False 07:32:39.151627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:32:40.408124 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:40.415629 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:32:40.449805 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:32:40.477656 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:32:40.530942 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:32:40.564592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:32:40.592330 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:32:41.146791 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:32:41.198667 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:41.210456 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:32:41.281421 tst mo_mt_call.py: using LAC 19907 07:32:41.402378 tst mo_mt_call.py: using RAC 17 07:32:41.521279 tst mo_mt_call.py: using CellId 19907 07:32:41.642358 tst mo_mt_call.py: using BVCI 19908 07:32:41.754095 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:41.765587 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:41.776729 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:41.787944 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:41.799287 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:41.810618 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:32:41.929404 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:32:42.053777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:42.522132 run create_hlr_db(pid=7656): Launched 07:32:42.639379 bus /sierra_2: Setting Powered False 07:32:43.699236 run create_hlr_db(pid=7656): Terminated: ok {rc=0} 07:32:44.141184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7658): Launched 07:32:44.466813 run osmo-hlr_10.42.42.2(pid=7659): Launched 07:32:44.590308 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:45.150505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7661): Launched 07:32:45.476340 run osmo-stp_10.42.42.5(pid=7662): Launched 07:32:45.599904 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:46.275775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7664): Launched 07:32:46.601057 run osmo-msc_10.42.42.6(pid=7665): Launched 07:32:47.058836 run osmo-stp_10.42.42.5(pid=7662): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7662)] 07:32:47.199311 run osmo-stp_10.42.42.5(pid=7662): stdout: | (launched: 2022-12-09_07:32:45.417314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:47.385248 run osmo-stp_10.42.42.5(pid=7662): stderr: | 20221209073245606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073245606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073245606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073245607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073245607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073245607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073245607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:47.512281 run osmo-stp_10.42.42.5(pid=7662): stdout: | (launched: 2022-12-09_07:32:45.417314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:47.633275 run osmo-stp_10.42.42.5(pid=7662): stderr: | 20221209073245606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073245606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073245606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073245607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073245607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073245607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073245607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:47.778298 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7662): Process ended prematurely: osmo-stp_10.42.42.5(pid=7662) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7662)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:32:47.787266 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:32:47.814082 run osmo-hlr_10.42.42.2(pid=7659): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7659)] 07:32:47.862009 run osmo-hlr_10.42.42.2(pid=7659): stdout: | (launched: 2022-12-09_07:32:44.407988) 07:32:47.911660 run osmo-hlr_10.42.42.2(pid=7659): stderr: | 20221209073244601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073244601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073244601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073244601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073244601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073244601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073244613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073244623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073244623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073244623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:47.980266 run osmo-msc_10.42.42.6(pid=7665): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7665)] 07:32:48.027783 run osmo-msc_10.42.42.6(pid=7665): stdout: | (launched: 2022-12-09_07:32:46.543773) 07:32:48.077163 run osmo-msc_10.42.42.6(pid=7665): stderr: | 20221209073246947 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073246947 DLGLOBAL DEBUG validating counter group 0x7f62ce40dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073246947 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073246947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073246947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073246947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073246949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073246949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073246950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073246950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:48.126798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7658): Terminating (SIGTERM) 07:32:48.166709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7661): Terminating (SIGTERM) 07:32:48.206418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7664): Terminating (SIGTERM) 07:32:48.246781 --- ParallelTerminationStrategy: PID 7658 died... 07:32:48.265473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7658): Terminated: ok {rc=0} 07:32:48.309653 --- ParallelTerminationStrategy: PID 7661 died... 07:32:48.328142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7661): Terminated: ok {rc=0} 07:32:48.372476 --- ParallelTerminationStrategy: PID 7664 died... 07:32:48.391078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7664): Terminated: ok {rc=0} 07:32:48.475554 bus /sierra_3: Setting Powered False 07:32:49.573583 bus /sierra_3: Setting Powered False 07:32:50.690575 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:32:51.840788 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:51.853463 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:32:51.925451 tst mo_mt_call_osmux.py: using LAC 19908 07:32:52.054708 tst mo_mt_call_osmux.py: using RAC 18 07:32:52.183340 tst mo_mt_call_osmux.py: using CellId 19908 07:32:52.309852 tst mo_mt_call_osmux.py: using BVCI 19909 07:32:52.429526 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:52.441244 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:52.452772 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:52.464312 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:52.476142 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:32:52.487602 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:32:52.607059 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:32:52.723967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:53.193560 run create_hlr_db(pid=7667): Launched 07:32:53.311333 bus /sierra_2: Setting Powered False 07:32:54.370710 run create_hlr_db(pid=7667): Terminated: ok {rc=0} 07:32:54.791005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7669): Launched 07:32:55.092404 run osmo-hlr_10.42.42.2(pid=7670): Launched 07:32:55.206450 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:55.735558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7672): Launched 07:32:56.036699 run osmo-stp_10.42.42.5(pid=7673): Launched 07:32:56.151662 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:56.695412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7675): Launched 07:32:56.997229 run osmo-msc_10.42.42.6(pid=7676): Launched 07:32:57.165531 run osmo-stp_10.42.42.5(pid=7673): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7673)] 07:32:57.293413 run osmo-stp_10.42.42.5(pid=7673): stdout: | (launched: 2022-12-09_07:32:55.981318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:57.420534 run osmo-stp_10.42.42.5(pid=7673): stderr: | 20221209073256148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073256148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073256148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073256148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073256149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073256149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073256149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:57.546022 run osmo-stp_10.42.42.5(pid=7673): stdout: | (launched: 2022-12-09_07:32:55.981318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:57.665966 run osmo-stp_10.42.42.5(pid=7673): stderr: | 20221209073256148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073256148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073256148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073256148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073256149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073256149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073256149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:57.810019 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7673): Process ended prematurely: osmo-stp_10.42.42.5(pid=7673) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7673)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:32:57.818967 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:32:57.845381 run osmo-hlr_10.42.42.2(pid=7670): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7670)] 07:32:57.892914 run osmo-hlr_10.42.42.2(pid=7670): stdout: | (launched: 2022-12-09_07:32:55.036315) 07:32:57.941909 run osmo-hlr_10.42.42.2(pid=7670): stderr: | 20221209073255210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073255210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073255210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073255210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073255210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073255210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073255223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073255231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073255232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073255232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:58.010068 run osmo-msc_10.42.42.6(pid=7676): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7676)] 07:32:58.057333 run osmo-msc_10.42.42.6(pid=7676): stdout: | (launched: 2022-12-09_07:32:56.941920) 07:32:58.106175 run osmo-msc_10.42.42.6(pid=7676): stderr: | 20221209073257207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073257207 DLGLOBAL DEBUG validating counter group 0x7f9b72f78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073257207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073257207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073257208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073257208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073257210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073257210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073257210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073257210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:58.155422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7669): Terminating (SIGTERM) 07:32:58.194721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7672): Terminating (SIGTERM) 07:32:58.234013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7675): Terminating (SIGTERM) 07:32:58.273564 --- ParallelTerminationStrategy: PID 7669 died... 07:32:58.292446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7669): Terminated: ok {rc=0} 07:32:58.336202 --- ParallelTerminationStrategy: PID 7672 died... 07:32:58.354522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7672): Terminated: ok {rc=0} 07:32:58.398529 --- ParallelTerminationStrategy: PID 7675 died... 07:32:58.416906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7675): Terminated: ok {rc=0} 07:32:58.501247 bus /sierra_3: Setting Powered False 07:32:59.599295 bus /sierra_3: Setting Powered False 07:33:00.713867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:33:01.995348 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:02.005546 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:33:02.052370 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:33:02.095073 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:33:02.154980 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:33:02.199909 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:33:02.235953 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:33:02.769601 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:33:02.822041 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:02.833888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:33:02.905242 tst mo_mt_call.py: using LAC 19909 07:33:03.033290 tst mo_mt_call.py: using RAC 19 07:33:03.159853 tst mo_mt_call.py: using CellId 19909 07:33:03.286268 tst mo_mt_call.py: using BVCI 19910 07:33:03.405504 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:03.417133 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:03.428470 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:03.439952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:03.451531 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:03.463021 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:33:03.583775 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:33:03.703421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:04.205238 run create_hlr_db(pid=7682): Launched 07:33:04.326288 bus /sierra_2: Setting Powered False 07:33:05.391334 run create_hlr_db(pid=7682): Terminated: ok {rc=0} 07:33:05.823556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7684): Launched 07:33:06.126105 run osmo-hlr_10.42.42.2(pid=7685): Launched 07:33:06.250091 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:06.774965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7687): Launched 07:33:07.076434 run osmo-stp_10.42.42.5(pid=7688): Launched 07:33:07.190302 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:07.734349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7690): Launched 07:33:08.034633 run osmo-msc_10.42.42.6(pid=7691): Launched 07:33:08.201933 run osmo-stp_10.42.42.5(pid=7688): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7688)] 07:33:08.328822 run osmo-stp_10.42.42.5(pid=7688): stdout: | (launched: 2022-12-09_07:33:07.021458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:08.455977 run osmo-stp_10.42.42.5(pid=7688): stderr: | 20221209073307187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073307188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073307188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073307188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073307189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073307189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073307189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:08.580682 run osmo-stp_10.42.42.5(pid=7688): stdout: | (launched: 2022-12-09_07:33:07.021458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:08.700304 run osmo-stp_10.42.42.5(pid=7688): stderr: | 20221209073307187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073307188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073307188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073307188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073307189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073307189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073307189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:08.843576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7688): Process ended prematurely: osmo-stp_10.42.42.5(pid=7688) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7688)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:33:08.852605 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:33:08.879058 run osmo-hlr_10.42.42.2(pid=7685): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7685)] 07:33:08.926541 run osmo-hlr_10.42.42.2(pid=7685): stdout: | (launched: 2022-12-09_07:33:06.070410) 07:33:08.975429 run osmo-hlr_10.42.42.2(pid=7685): stderr: | 20221209073306244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073306244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073306244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073306244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073306244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073306244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073306257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073306265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073306265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073306265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:09.043967 run osmo-msc_10.42.42.6(pid=7691): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7691)] 07:33:09.091480 run osmo-msc_10.42.42.6(pid=7691): stdout: | (launched: 2022-12-09_07:33:07.979383) 07:33:09.140515 run osmo-msc_10.42.42.6(pid=7691): stderr: | 20221209073308248 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073308249 DLGLOBAL DEBUG validating counter group 0x7f8cf26f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073308249 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073308249 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073308249 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073308249 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073308251 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073308252 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073308252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073308252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:09.189549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7684): Terminating (SIGTERM) 07:33:09.228924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7687): Terminating (SIGTERM) 07:33:09.268081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7690): Terminating (SIGTERM) 07:33:09.307410 --- ParallelTerminationStrategy: PID 7684 died... 07:33:09.326279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7684): Terminated: ok {rc=0} 07:33:09.370140 --- ParallelTerminationStrategy: PID 7687 died... 07:33:09.388546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7687): Terminated: ok {rc=0} 07:33:09.432676 --- ParallelTerminationStrategy: PID 7690 died... 07:33:09.451136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7690): Terminated: ok {rc=0} 07:33:09.535006 bus /sierra_3: Setting Powered False 07:33:10.633708 bus /sierra_3: Setting Powered False 07:33:11.750023 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:33:12.899778 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:12.912166 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:33:12.984286 tst mo_mt_call_osmux.py: using LAC 19910 07:33:13.110614 tst mo_mt_call_osmux.py: using RAC 20 07:33:13.238697 tst mo_mt_call_osmux.py: using CellId 19910 07:33:13.367683 tst mo_mt_call_osmux.py: using BVCI 19911 07:33:13.486603 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:13.498348 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:13.509840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:13.521279 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:13.533154 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:33:13.544481 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:33:13.664250 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:33:13.779769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:14.247432 run create_hlr_db(pid=7693): Launched 07:33:14.363051 bus /sierra_2: Setting Powered False 07:33:15.424417 run create_hlr_db(pid=7693): Terminated: ok {rc=0} 07:33:15.855746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7695): Launched 07:33:16.217665 run osmo-hlr_10.42.42.2(pid=7696): Launched 07:33:16.472211 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:17.133154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7698): Launched 07:33:17.470927 run osmo-stp_10.42.42.5(pid=7699): Launched 07:33:17.596139 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:18.182285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7701): Launched 07:33:18.507466 run osmo-msc_10.42.42.6(pid=7702): Launched 07:33:18.688813 run osmo-stp_10.42.42.5(pid=7699): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7699)] 07:33:18.825193 run osmo-stp_10.42.42.5(pid=7699): stdout: | (launched: 2022-12-09_07:33:17.412005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:18.961732 run osmo-stp_10.42.42.5(pid=7699): stderr: | 20221209073317602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073317602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073317602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073317603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073317603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073317603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073317603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:19.096764 run osmo-stp_10.42.42.5(pid=7699): stdout: | (launched: 2022-12-09_07:33:17.412005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:19.225942 run osmo-stp_10.42.42.5(pid=7699): stderr: | 20221209073317602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073317602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073317602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073317603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073317603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073317603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073317603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:19.380283 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7699): Process ended prematurely: osmo-stp_10.42.42.5(pid=7699) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7699)] [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:33:19.390098 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:33:19.418046 run osmo-hlr_10.42.42.2(pid=7696): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7696)] 07:33:19.467939 run osmo-hlr_10.42.42.2(pid=7696): stdout: | (launched: 2022-12-09_07:33:16.151290) 07:33:19.519145 run osmo-hlr_10.42.42.2(pid=7696): stderr: | 20221209073316418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073316418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073316418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073316418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073316418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073316418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073316442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073316450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073316450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073316451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:19.590894 run osmo-msc_10.42.42.6(pid=7702): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7702)] 07:33:19.640516 run osmo-msc_10.42.42.6(pid=7702): stdout: | (launched: 2022-12-09_07:33:18.448411) 07:33:19.691645 run osmo-msc_10.42.42.6(pid=7702): stderr: | 20221209073318766 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073318766 DLGLOBAL DEBUG validating counter group 0x7fa36a032c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073318766 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073318766 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073318767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073318767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073318768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073318769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073318769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073318769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:19.743836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7695): Terminating (SIGTERM) 07:33:19.785980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7698): Terminating (SIGTERM) 07:33:19.827603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7701): Terminating (SIGTERM) 07:33:19.869534 --- ParallelTerminationStrategy: PID 7695 died... 07:33:19.889625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7695): Terminated: ok {rc=0} 07:33:19.935885 --- ParallelTerminationStrategy: PID 7698 died... 07:33:19.955635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7698): Terminated: ok {rc=0} 07:33:20.001469 --- ParallelTerminationStrategy: PID 7701 died... 07:33:20.021072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7701): Terminated: ok {rc=0} 07:33:20.109597 bus /sierra_3: Setting Powered False 07:33:21.207121 bus /sierra_3: Setting Powered False 07:33:22.324211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:33:23.583795 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:23.590942 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:33:23.625143 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:33:23.652887 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:33:23.706884 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:33:23.740939 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:33:23.768611 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:33:24.320830 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:33:24.372652 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:24.384385 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:33:24.456582 tst mo_mt_call.py: using LAC 19911 07:33:24.584729 tst mo_mt_call.py: using RAC 21 07:33:24.714426 tst mo_mt_call.py: using CellId 19911 07:33:24.841619 tst mo_mt_call.py: using BVCI 19912 07:33:24.961268 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:24.973172 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:24.984838 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:24.996551 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:25.008156 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:25.019714 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:33:25.142043 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:33:25.263709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:25.767670 run create_hlr_db(pid=7708): Launched 07:33:25.899896 bus /sierra_2: Setting Powered False 07:33:26.963576 run create_hlr_db(pid=7708): Terminated: ok {rc=0} 07:33:27.395172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7710): Launched 07:33:27.696774 run osmo-hlr_10.42.42.2(pid=7711): Launched 07:33:27.811026 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:28.343167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7713): Launched 07:33:28.645875 run osmo-stp_10.42.42.5(pid=7714): Launched 07:33:28.760446 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:29.308139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7716): Launched 07:33:29.610921 run osmo-msc_10.42.42.6(pid=7717): Launched 07:33:29.778792 run osmo-stp_10.42.42.5(pid=7714): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7714)] 07:33:29.906347 run osmo-stp_10.42.42.5(pid=7714): stdout: | (launched: 2022-12-09_07:33:28.590526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:30.034475 run osmo-stp_10.42.42.5(pid=7714): stderr: | 20221209073328758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073328758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073328759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073328759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073328759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073328760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073328760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:30.160317 run osmo-stp_10.42.42.5(pid=7714): stdout: | (launched: 2022-12-09_07:33:28.590526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:30.280387 run osmo-stp_10.42.42.5(pid=7714): stderr: | 20221209073328758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073328758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073328759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073328759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073328759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073328760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073328760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:30.424192 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7714): Process ended prematurely: osmo-stp_10.42.42.5(pid=7714) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7714)] [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:33:30.433210 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:33:30.459678 run osmo-hlr_10.42.42.2(pid=7711): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7711)] 07:33:30.507427 run osmo-hlr_10.42.42.2(pid=7711): stdout: | (launched: 2022-12-09_07:33:27.641546) 07:33:30.556739 run osmo-hlr_10.42.42.2(pid=7711): stderr: | 20221209073327814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073327814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073327814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073327814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073327814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073327814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073327826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073327835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073327835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073327835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:30.625395 run osmo-msc_10.42.42.6(pid=7717): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7717)] 07:33:30.672877 run osmo-msc_10.42.42.6(pid=7717): stdout: | (launched: 2022-12-09_07:33:29.555632) 07:33:30.721719 run osmo-msc_10.42.42.6(pid=7717): stderr: | 20221209073329824 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073329824 DLGLOBAL DEBUG validating counter group 0x7fcaf5145c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073329824 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073329824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073329825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073329825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073329826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073329827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073329827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073329827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:30.771002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7710): Terminating (SIGTERM) 07:33:30.810509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7713): Terminating (SIGTERM) 07:33:30.855389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7716): Terminating (SIGTERM) 07:33:30.911495 --- ParallelTerminationStrategy: PID 7710 died... 07:33:30.931108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7710): Terminated: ok {rc=0} 07:33:30.977359 --- ParallelTerminationStrategy: PID 7713 died... 07:33:30.997125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7713): Terminated: ok {rc=0} 07:33:31.043959 --- ParallelTerminationStrategy: PID 7716 died... 07:33:31.063698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7716): Terminated: ok {rc=0} 07:33:31.151311 bus /sierra_3: Setting Powered False 07:33:32.252094 bus /sierra_3: Setting Powered False 07:33:33.370459 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:33:34.516196 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:34.528318 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:33:34.604435 tst mo_mt_call_osmux.py: using LAC 19912 07:33:34.731896 tst mo_mt_call_osmux.py: using RAC 22 07:33:34.849696 tst mo_mt_call_osmux.py: using CellId 19912 07:33:34.976859 tst mo_mt_call_osmux.py: using BVCI 19913 07:33:35.094958 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:35.107031 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:35.118888 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:35.130708 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:35.142605 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:33:35.154452 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:33:35.272558 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:33:35.391471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:35.860051 run create_hlr_db(pid=7719): Launched 07:33:35.974634 bus /sierra_2: Setting Powered False 07:33:37.035392 run create_hlr_db(pid=7719): Terminated: ok {rc=0} 07:33:37.456505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7721): Launched 07:33:37.758858 run osmo-hlr_10.42.42.2(pid=7722): Launched 07:33:37.874372 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:38.403558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Launched 07:33:38.703723 run osmo-stp_10.42.42.5(pid=7725): Launched 07:33:38.817517 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:39.361147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Launched 07:33:39.686061 run osmo-msc_10.42.42.6(pid=7728): Launched 07:33:39.866229 run osmo-stp_10.42.42.5(pid=7725): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] 07:33:40.002202 run osmo-stp_10.42.42.5(pid=7725): stdout: | (launched: 2022-12-09_07:33:38.648681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:40.138183 run osmo-stp_10.42.42.5(pid=7725): stderr: | 20221209073338818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073338818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073338818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073338818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073338819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073338819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073338819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:40.273119 run osmo-stp_10.42.42.5(pid=7725): stdout: | (launched: 2022-12-09_07:33:38.648681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:40.402325 run osmo-stp_10.42.42.5(pid=7725): stderr: | 20221209073338818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073338818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073338818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073338818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073338819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073338819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073338819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:40.557923 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7725): Process ended prematurely: osmo-stp_10.42.42.5(pid=7725) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:33:40.567715 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:33:40.595669 run osmo-hlr_10.42.42.2(pid=7722): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7722)] 07:33:40.645455 run osmo-hlr_10.42.42.2(pid=7722): stdout: | (launched: 2022-12-09_07:33:37.702667) 07:33:40.696426 run osmo-hlr_10.42.42.2(pid=7722): stderr: | 20221209073337874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073337874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073337874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073337874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073337874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073337874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073337887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073337895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073337895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073337895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:40.768222 run osmo-msc_10.42.42.6(pid=7728): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7728)] 07:33:40.817890 run osmo-msc_10.42.42.6(pid=7728): stdout: | (launched: 2022-12-09_07:33:39.627203) 07:33:40.869248 run osmo-msc_10.42.42.6(pid=7728): stderr: | 20221209073339945 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073339946 DLGLOBAL DEBUG validating counter group 0x7f32b60a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073339946 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073339946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073339946 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073339946 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073339949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073339949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073339949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073339949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:40.920515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7721): Terminating (SIGTERM) 07:33:40.961922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Terminating (SIGTERM) 07:33:41.003313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Terminating (SIGTERM) 07:33:41.044848 --- ParallelTerminationStrategy: PID 7721 died... 07:33:41.064775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7721): Terminated: ok {rc=0} 07:33:41.110835 --- ParallelTerminationStrategy: PID 7724 died... 07:33:41.130810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Terminated: ok {rc=0} 07:33:41.176530 --- ParallelTerminationStrategy: PID 7727 died... 07:33:41.196094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Terminated: ok {rc=0} 07:33:41.282244 bus /sierra_3: Setting Powered False 07:33:42.379533 bus /sierra_3: Setting Powered False 07:33:43.495386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:33:44.740909 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:44.746581 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:33:44.780005 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:33:44.807108 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:33:44.860849 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:33:44.894364 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:33:44.921263 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:33:45.469787 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:33:45.518047 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:45.529074 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:33:45.598757 tst mo_mt_call.py: using LAC 19913 07:33:45.719236 tst mo_mt_call.py: using RAC 23 07:33:45.840837 tst mo_mt_call.py: using CellId 19913 07:33:45.972669 tst mo_mt_call.py: using BVCI 19914 07:33:46.084238 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:46.095923 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:46.107356 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:46.119034 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:46.130681 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:46.142368 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:33:46.256781 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:33:46.374761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:46.890044 run create_hlr_db(pid=7734): Launched 07:33:47.053210 bus /sierra_2: Setting Powered False 07:33:48.113255 run create_hlr_db(pid=7734): Terminated: ok {rc=0} 07:33:48.554209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7736): Launched 07:33:48.880554 run osmo-hlr_10.42.42.2(pid=7737): Launched 07:33:49.004262 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:49.559485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7739): Launched 07:33:49.886652 run osmo-stp_10.42.42.5(pid=7740): Launched 07:33:50.011128 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:50.595541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7742): Launched 07:33:50.920306 run osmo-msc_10.42.42.6(pid=7743): Launched 07:33:51.099891 run osmo-stp_10.42.42.5(pid=7740): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7740)] 07:33:51.236495 run osmo-stp_10.42.42.5(pid=7740): stdout: | (launched: 2022-12-09_07:33:49.826896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:51.372587 run osmo-stp_10.42.42.5(pid=7740): stderr: | 20221209073350015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073350015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073350015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073350016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073350016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073350016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073350016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:51.507374 run osmo-stp_10.42.42.5(pid=7740): stdout: | (launched: 2022-12-09_07:33:49.826896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:51.636516 run osmo-stp_10.42.42.5(pid=7740): stderr: | 20221209073350015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073350015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073350015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073350016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073350016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073350016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073350016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:51.791705 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7740): Process ended prematurely: osmo-stp_10.42.42.5(pid=7740) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7740)] [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:33:51.801368 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:33:51.828828 run osmo-hlr_10.42.42.2(pid=7737): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7737)] 07:33:51.878665 run osmo-hlr_10.42.42.2(pid=7737): stdout: | (launched: 2022-12-09_07:33:48.821431) 07:33:51.929941 run osmo-hlr_10.42.42.2(pid=7737): stderr: | 20221209073349016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073349016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073349016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073349017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073349017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073349017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073349032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073349040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073349041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073349041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:52.001396 run osmo-msc_10.42.42.6(pid=7743): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7743)] 07:33:52.050908 run osmo-msc_10.42.42.6(pid=7743): stdout: | (launched: 2022-12-09_07:33:50.861435) 07:33:52.102108 run osmo-msc_10.42.42.6(pid=7743): stderr: | 20221209073351181 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073351181 DLGLOBAL DEBUG validating counter group 0x7f63d00bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073351181 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073351181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073351181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073351182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073351183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073351184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073351184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073351184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:52.153488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7736): Terminating (SIGTERM) 07:33:52.194706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7739): Terminating (SIGTERM) 07:33:52.236149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7742): Terminating (SIGTERM) 07:33:52.277779 --- ParallelTerminationStrategy: PID 7736 died... 07:33:52.297416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7736): Terminated: ok {rc=0} 07:33:52.343277 --- ParallelTerminationStrategy: PID 7739 died... 07:33:52.362815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7739): Terminated: ok {rc=0} 07:33:52.408432 --- ParallelTerminationStrategy: PID 7742 died... 07:33:52.427714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7742): Terminated: ok {rc=0} 07:33:52.513887 bus /sierra_3: Setting Powered False 07:33:53.613106 bus /sierra_3: Setting Powered False 07:33:54.728275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:33:55.876725 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:55.889293 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:33:55.961805 tst mo_mt_call_osmux.py: using LAC 19914 07:33:56.090269 tst mo_mt_call_osmux.py: using RAC 24 07:33:56.217045 tst mo_mt_call_osmux.py: using CellId 19914 07:33:56.337971 tst mo_mt_call_osmux.py: using BVCI 19915 07:33:56.450281 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:56.461271 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:56.472226 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:56.483441 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:56.494670 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:33:56.505896 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:33:56.625390 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:33:56.742819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:57.211672 run create_hlr_db(pid=7745): Launched 07:33:57.327376 bus /sierra_2: Setting Powered False 07:33:58.387290 run create_hlr_db(pid=7745): Terminated: ok {rc=0} 07:33:58.830166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7747): Launched 07:33:59.153687 run osmo-hlr_10.42.42.2(pid=7748): Launched 07:33:59.278528 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:59.838942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7750): Launched 07:34:00.162799 run osmo-stp_10.42.42.5(pid=7751): Launched 07:34:00.285740 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:00.889815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7753): Launched 07:34:01.225776 run osmo-msc_10.42.42.6(pid=7754): Launched 07:34:01.578062 run osmo-stp_10.42.42.5(pid=7751): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7751)] 07:34:01.833844 run osmo-stp_10.42.42.5(pid=7751): stdout: | (launched: 2022-12-09_07:34:00.103867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:02.049860 run osmo-stp_10.42.42.5(pid=7751): stderr: | 20221209073400293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073400293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073400294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073400294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073400294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073400294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073400294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:02.246655 run osmo-stp_10.42.42.5(pid=7751): stdout: | (launched: 2022-12-09_07:34:00.103867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:02.379448 run osmo-stp_10.42.42.5(pid=7751): stderr: | 20221209073400293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073400293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073400294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073400294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073400294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073400294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073400294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:02.533962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7751): Process ended prematurely: osmo-stp_10.42.42.5(pid=7751) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7751)] [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:34:02.543818 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:34:02.571796 run osmo-hlr_10.42.42.2(pid=7748): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7748)] 07:34:02.621541 run osmo-hlr_10.42.42.2(pid=7748): stdout: | (launched: 2022-12-09_07:33:59.094958) 07:34:02.672553 run osmo-hlr_10.42.42.2(pid=7748): stderr: | 20221209073359291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073359291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073359291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073359291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073359291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073359291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073359304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073359314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073359314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073359315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:02.744208 run osmo-msc_10.42.42.6(pid=7754): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7754)] 07:34:02.793858 run osmo-msc_10.42.42.6(pid=7754): stdout: | (launched: 2022-12-09_07:34:01.168744) 07:34:02.844770 run osmo-msc_10.42.42.6(pid=7754): stderr: | 20221209073401756 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073401756 DLGLOBAL DEBUG validating counter group 0x7feee466cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073401756 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073401756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073401756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073401756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073401758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073401759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073401759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073401759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:02.896233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7747): Terminating (SIGTERM) 07:34:02.937416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7750): Terminating (SIGTERM) 07:34:02.978823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7753): Terminating (SIGTERM) 07:34:03.020638 --- ParallelTerminationStrategy: PID 7747 died... 07:34:03.040407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7747): Terminated: ok {rc=0} 07:34:03.086722 --- ParallelTerminationStrategy: PID 7750 died... 07:34:03.106304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7750): Terminated: ok {rc=0} 07:34:03.152115 --- ParallelTerminationStrategy: PID 7753 died... 07:34:03.171597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7753): Terminated: ok {rc=0} 07:34:03.259257 bus /sierra_3: Setting Powered False 07:34:04.358619 bus /sierra_3: Setting Powered False 07:34:05.473912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:34:06.724587 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:06.732667 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:34:06.767672 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 07:34:06.795486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 07:34:06.848647 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:34:06.882342 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 07:34:06.910157 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 07:34:07.461846 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 07:34:07.511436 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:07.523144 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:34:07.575017 tst mo_mt_call.py: using LAC 19915 07:34:07.693365 tst mo_mt_call.py: using RAC 25 07:34:07.814910 tst mo_mt_call.py: using CellId 19915 07:34:07.934484 tst mo_mt_call.py: using BVCI 19916 07:34:08.045358 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:08.056593 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:08.067814 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:08.079478 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:08.091044 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:08.102532 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:34:08.221987 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:34:08.342507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:08.843302 run create_hlr_db(pid=7759): Launched 07:34:08.973980 bus /sierra_2: Setting Powered False 07:34:10.033955 run create_hlr_db(pid=7759): Terminated: ok {rc=0} 07:34:10.483060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Launched 07:34:10.806886 run osmo-hlr_10.42.42.2(pid=7762): Launched 07:34:10.930982 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:11.488580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Launched 07:34:11.811962 run osmo-stp_10.42.42.5(pid=7765): Launched 07:34:11.934462 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:12.535441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7767): Launched 07:34:12.860169 run osmo-msc_10.42.42.6(pid=7768): Launched 07:34:13.040865 run osmo-stp_10.42.42.5(pid=7765): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] 07:34:13.176024 run osmo-stp_10.42.42.5(pid=7765): stdout: | (launched: 2022-12-09_07:34:11.752681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:13.311931 run osmo-stp_10.42.42.5(pid=7765): stderr: | 20221209073411997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073411997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073411997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073411998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073411998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073411998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073411998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:13.447719 run osmo-stp_10.42.42.5(pid=7765): stdout: | (launched: 2022-12-09_07:34:11.752681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:13.577065 run osmo-stp_10.42.42.5(pid=7765): stderr: | 20221209073411997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073411997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073411997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073411998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073411998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073411998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073411998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:13.731719 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7765): Process ended prematurely: osmo-stp_10.42.42.5(pid=7765) [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 07:34:13.741750 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:34:13.769552 run osmo-hlr_10.42.42.2(pid=7762): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7762)] 07:34:13.819692 run osmo-hlr_10.42.42.2(pid=7762): stdout: | (launched: 2022-12-09_07:34:10.747830) 07:34:13.871149 run osmo-hlr_10.42.42.2(pid=7762): stderr: | 20221209073410941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073410941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073410941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073410941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073410941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073410941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073410953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073410962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073410962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073410962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:13.943052 run osmo-msc_10.42.42.6(pid=7768): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7768)] 07:34:13.992849 run osmo-msc_10.42.42.6(pid=7768): stdout: | (launched: 2022-12-09_07:34:12.801104) 07:34:14.044376 run osmo-msc_10.42.42.6(pid=7768): stderr: | 20221209073413120 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073413120 DLGLOBAL DEBUG validating counter group 0x7f63f9a4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073413120 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073413120 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073413120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073413121 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073413122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073413123 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073413123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073413123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:14.096063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Terminating (SIGTERM) 07:34:14.137253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Terminating (SIGTERM) 07:34:14.178575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7767): Terminating (SIGTERM) 07:34:14.220331 --- ParallelTerminationStrategy: PID 7761 died... 07:34:14.240138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Terminated: ok {rc=0} 07:34:14.286023 --- ParallelTerminationStrategy: PID 7764 died... 07:34:14.305454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Terminated: ok {rc=0} 07:34:14.351526 --- ParallelTerminationStrategy: PID 7767 died... 07:34:14.370945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7767): Terminated: ok {rc=0} 07:34:14.458214 bus /sierra_3: Setting Powered False 07:34:15.555934 bus /sierra_3: Setting Powered False 07:34:16.671804 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 07:34:17.831087 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:17.843635 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:34:17.897617 tst mo_mt_call_osmux.py: using LAC 19916 07:34:18.025810 tst mo_mt_call_osmux.py: using RAC 26 07:34:18.156862 tst mo_mt_call_osmux.py: using CellId 19916 07:34:18.283402 tst mo_mt_call_osmux.py: using BVCI 19917 07:34:18.396237 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:18.408019 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:18.419486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:18.430809 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:18.442330 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:34:18.453868 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:34:18.570164 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:34:18.689689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:19.194134 run create_hlr_db(pid=7770): Launched 07:34:19.326951 bus /sierra_2: Setting Powered False 07:34:20.391435 run create_hlr_db(pid=7770): Terminated: ok {rc=0} 07:34:20.824480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7772): Launched 07:34:21.129083 run osmo-hlr_10.42.42.2(pid=7773): Launched 07:34:21.245198 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:21.769597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7775): Launched 07:34:22.072531 run osmo-stp_10.42.42.5(pid=7776): Launched 07:34:22.187896 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:22.735833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7778): Launched 07:34:23.039367 run osmo-msc_10.42.42.6(pid=7779): Launched 07:34:23.208641 run osmo-stp_10.42.42.5(pid=7776): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7776)] 07:34:23.336823 run osmo-stp_10.42.42.5(pid=7776): stdout: | (launched: 2022-12-09_07:34:22.017211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:23.465740 run osmo-stp_10.42.42.5(pid=7776): stderr: | 20221209073422183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073422183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073422183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073422184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073422184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073422184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073422185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:23.591795 run osmo-stp_10.42.42.5(pid=7776): stdout: | (launched: 2022-12-09_07:34:22.017211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:23.713238 run osmo-stp_10.42.42.5(pid=7776): stderr: | 20221209073422183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073422183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073422183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073422184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073422184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073422184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073422185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:23.858872 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7776): Process ended prematurely: osmo-stp_10.42.42.5(pid=7776) [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7776)] [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 07:34:23.867989 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:34:23.894689 run osmo-hlr_10.42.42.2(pid=7773): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7773)] 07:34:23.942323 run osmo-hlr_10.42.42.2(pid=7773): stdout: | (launched: 2022-12-09_07:34:21.072467) 07:34:23.991571 run osmo-hlr_10.42.42.2(pid=7773): stderr: | 20221209073421246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073421246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073421246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073421246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073421246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073421246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073421258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073421269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073421269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073421269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:24.059937 run osmo-msc_10.42.42.6(pid=7779): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7779)] 07:34:24.107330 run osmo-msc_10.42.42.6(pid=7779): stdout: | (launched: 2022-12-09_07:34:22.983487) 07:34:24.156900 run osmo-msc_10.42.42.6(pid=7779): stderr: | 20221209073423254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073423254 DLGLOBAL DEBUG validating counter group 0x7f3bfa3ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073423254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073423254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073423254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073423254 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073423256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073423256 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073423257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073423257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:24.206443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7772): Terminating (SIGTERM) 07:34:24.245813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7775): Terminating (SIGTERM) 07:34:24.284897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7778): Terminating (SIGTERM) 07:34:24.325005 --- ParallelTerminationStrategy: PID 7772 died... 07:34:24.343840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7772): Terminated: ok {rc=0} 07:34:24.387985 --- ParallelTerminationStrategy: PID 7775 died... 07:34:24.406978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7775): Terminated: ok {rc=0} 07:34:24.450781 --- ParallelTerminationStrategy: PID 7778 died... 07:34:24.469120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7778): Terminated: ok {rc=0} 07:34:24.552367 bus /sierra_3: Setting Powered False 07:34:25.649776 bus /sierra_3: Setting Powered False 07:34:26.766178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:trx-umtrx --------------------------------------------------------------------- 07:34:28.015528 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:28.019922 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:34:28.053462 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:34:28.080242 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 07:34:28.165523 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:34:28.198169 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:34:28.225200 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 07:34:28.808374 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 07:34:28.813379 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:28.823981 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 07:34:28.872681 tst emergency_mo_mt_call.py: using LAC 19917 07:34:28.988719 tst emergency_mo_mt_call.py: using RAC 27 07:34:29.104926 tst emergency_mo_mt_call.py: using CellId 19917 07:34:29.220642 tst emergency_mo_mt_call.py: using BVCI 19918 07:34:29.327780 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:29.338600 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:29.349172 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:29.360075 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:29.371278 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:29.382090 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:29.500442 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:29.620131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:30.083719 run create_hlr_db(pid=7784): Launched 07:34:30.197258 bus /sierra_2: Setting Powered False 07:34:31.287144 run create_hlr_db(pid=7784): Terminated: ok {rc=0} 07:34:31.747995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7786): Launched 07:34:32.062992 run osmo-hlr_10.42.42.2(pid=7787): Launched 07:34:32.254863 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:32.810281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7789): Launched 07:34:33.129134 run osmo-stp_10.42.42.5(pid=7790): Launched 07:34:33.259205 tst emergency_mo_mt_call.py: using MSISDN 7090 07:34:33.422864 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:33.998198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7792): Launched 07:34:34.316817 run osmo-msc_10.42.42.6(pid=7793): Launched 07:34:34.495285 run osmo-stp_10.42.42.5(pid=7790): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7790)] 07:34:34.629711 run osmo-stp_10.42.42.5(pid=7790): stdout: | (launched: 2022-12-09_07:34:33.070668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:34.765319 run osmo-stp_10.42.42.5(pid=7790): stderr: | 20221209073433260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073433260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073433260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073433261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073433261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073433261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073433261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:34.899604 run osmo-stp_10.42.42.5(pid=7790): stdout: | (launched: 2022-12-09_07:34:33.070668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:35.026892 run osmo-stp_10.42.42.5(pid=7790): stderr: | 20221209073433260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073433260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073433260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073433261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073433261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073433261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073433261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:35.179043 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7790): Process ended prematurely: osmo-stp_10.42.42.5(pid=7790) [trial-2356↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7790)] [trial-2356↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 07:34:35.188243 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 07:34:35.215560 run osmo-hlr_10.42.42.2(pid=7787): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7787)] 07:34:35.265581 run osmo-hlr_10.42.42.2(pid=7787): stdout: | (launched: 2022-12-09_07:34:32.007680) 07:34:35.317260 run osmo-hlr_10.42.42.2(pid=7787): stderr: | 20221209073432274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073432274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073432274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073432274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073432274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073432274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073432293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073432301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073432302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073432302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:35.388830 run osmo-msc_10.42.42.6(pid=7793): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7793)] 07:34:35.438558 run osmo-msc_10.42.42.6(pid=7793): stdout: | (launched: 2022-12-09_07:34:34.258243) 07:34:35.489744 run osmo-msc_10.42.42.6(pid=7793): stderr: | 20221209073434577 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073434578 DLGLOBAL DEBUG validating counter group 0x7f2f52a23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073434578 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073434578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073434578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073434578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073434580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073434581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073434581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073434581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:35.541413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7786): Terminating (SIGTERM) 07:34:35.582916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7789): Terminating (SIGTERM) 07:34:35.624445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7792): Terminating (SIGTERM) 07:34:35.666322 --- ParallelTerminationStrategy: PID 7786 died... 07:34:35.686141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7786): Terminated: ok {rc=0} 07:34:35.732021 --- ParallelTerminationStrategy: PID 7789 died... 07:34:35.751472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7789): Terminated: ok {rc=0} 07:34:35.797263 --- ParallelTerminationStrategy: PID 7792 died... 07:34:35.817023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7792): Terminated: ok {rc=0} 07:34:35.904700 bus /sierra_3: Setting Powered False 07:34:37.003502 bus /sierra_3: Setting Powered False 07:34:38.117898 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 07:34:39.204133 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:39.216316 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 07:34:39.270456 tst emergency_preemptive_call.py: using LAC 19918 07:34:39.397664 tst emergency_preemptive_call.py: using RAC 28 07:34:39.524492 tst emergency_preemptive_call.py: using CellId 19918 07:34:39.652058 tst emergency_preemptive_call.py: using BVCI 19919 07:34:39.770406 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:39.781935 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:39.793205 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:39.804766 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:39.816673 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:34:39.828242 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:39.946175 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:40.065189 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:40.180611 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:40.293783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:40.758278 run create_hlr_db(pid=7795): Launched 07:34:40.872750 bus /sierra_2: Setting Powered False 07:34:41.932457 run create_hlr_db(pid=7795): Terminated: ok {rc=0} 07:34:42.370482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Launched 07:34:42.689595 run osmo-hlr_10.42.42.2(pid=7798): Launched 07:34:42.811160 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:43.362321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Launched 07:34:43.684281 run osmo-stp_10.42.42.5(pid=7801): Launched 07:34:43.816454 tst emergency_preemptive_call.py: using MSISDN 7091 07:34:43.979909 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:44.553090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Launched 07:34:44.871916 run osmo-msc_10.42.42.6(pid=7804): Launched 07:34:45.050010 run osmo-stp_10.42.42.5(pid=7801): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] 07:34:45.185312 run osmo-stp_10.42.42.5(pid=7801): stdout: | (launched: 2022-12-09_07:34:43.625467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:45.321399 run osmo-stp_10.42.42.5(pid=7801): stderr: | 20221209073443814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073443814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073443814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073443815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073443815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073443815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073443816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:45.455681 run osmo-stp_10.42.42.5(pid=7801): stdout: | (launched: 2022-12-09_07:34:43.625467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:45.582869 run osmo-stp_10.42.42.5(pid=7801): stderr: | 20221209073443814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073443814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073443814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073443815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073443815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073443815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073443816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:45.735870 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7801): Process ended prematurely: osmo-stp_10.42.42.5(pid=7801) [trial-2356↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] [trial-2356↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 07:34:45.745000 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 07:34:45.772580 run osmo-hlr_10.42.42.2(pid=7798): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7798)] 07:34:45.822299 run osmo-hlr_10.42.42.2(pid=7798): stdout: | (launched: 2022-12-09_07:34:42.631179) 07:34:45.879360 run osmo-hlr_10.42.42.2(pid=7798): stderr: | 20221209073442824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073442824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073442824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073442825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073442825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073442825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073442837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073442845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073442845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073442845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:45.952436 run osmo-msc_10.42.42.6(pid=7804): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7804)] 07:34:46.003798 run osmo-msc_10.42.42.6(pid=7804): stdout: | (launched: 2022-12-09_07:34:44.813426) 07:34:46.055450 run osmo-msc_10.42.42.6(pid=7804): stderr: | 20221209073445131 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209073445131 DLGLOBAL DEBUG validating counter group 0x7f22252d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209073445131 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209073445132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209073445132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209073445132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209073445134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209073445134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209073445134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209073445134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:46.108606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Terminating (SIGTERM) 07:34:46.151207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Terminating (SIGTERM) 07:34:46.196535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Terminating (SIGTERM) 07:34:46.241372 --- ParallelTerminationStrategy: PID 7797 died... 07:34:46.262415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Terminated: ok {rc=0} 07:34:46.311469 --- ParallelTerminationStrategy: PID 7800 died... 07:34:46.331169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Terminated: ok {rc=0} 07:34:46.378781 --- ParallelTerminationStrategy: PID 7803 died... 07:34:46.399881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Terminated: ok {rc=0} 07:34:46.487473 bus /sierra_9: Setting Powered False 07:34:47.585101 bus /sierra_9: Setting Powered False 07:34:48.700295 bus /sierra_8: Setting Powered False 07:34:49.797985 bus /sierra_8: Setting Powered False 07:34:50.913244 bus /sierra_3: Setting Powered False 07:34:52.010184 bus /sierra_3: Setting Powered False 07:34:53.122975 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx --------------------------------------------------------------------- 07:34:54.407544 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:54.412122 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:34:54.445724 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 07:34:54.485620 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 07:34:54.575152 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:34:54.608825 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 07:34:54.648641 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 07:34:55.242256 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 07:34:55.295006 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.306181 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:34:55.356005 tst cs_paging_gprs_active.py: using LAC 19919 07:34:55.485091 tst cs_paging_gprs_active.py: using RAC 29 07:34:55.613531 tst cs_paging_gprs_active.py: using CellId 19919 07:34:55.742512 tst cs_paging_gprs_active.py: using BVCI 19920 07:34:55.862917 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.874235 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.885229 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.896164 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.907116 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.918046 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.929129 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.939917 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:55.950988 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:56.069316 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:56.191124 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:34:56.411268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:56.738518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7809): Launched 07:34:57.022872 run iperf3-srv_10.42.42.10(pid=7810): Launched 07:34:57.146784 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:34:57.367144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:57.694193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7811): Launched 07:34:57.979516 run iperf3-srv_10.42.42.10(pid=7812): Launched 07:34:58.103243 tst cs_paging_gprs_active.py:38: start network... 07:34:58.323039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:58.828703 run create_hlr_db(pid=7813): Launched 07:34:58.959964 bus /sierra_2: Setting Powered False 07:35:00.025221 run create_hlr_db(pid=7813): Terminated: ok {rc=0} 07:35:00.461043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7815): Launched 07:35:00.766415 run osmo-hlr_10.42.42.2(pid=7816): Launched 07:35:00.934925 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:01.634864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7821): Launched 07:35:02.005696 run osmo-stp_10.42.42.5(pid=7822): Launched 07:35:02.305279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:02.827470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7824): Launched 07:35:02.945160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:03.200343 run patchelf(pid=7825): Launched 07:35:03.368351 run osmo-stp_10.42.42.5(pid=7822): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7822)] 07:35:03.496680 run osmo-stp_10.42.42.5(pid=7822): stdout: | (launched: 2022-12-09_07:35:01.927915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:03.626248 run osmo-stp_10.42.42.5(pid=7822): stderr: | 20221209073502131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073502131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073502132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073502132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073502132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073502133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073502133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:03.756196 run osmo-stp_10.42.42.5(pid=7822): stdout: | (launched: 2022-12-09_07:35:01.927915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:03.880729 run osmo-stp_10.42.42.5(pid=7822): stderr: | 20221209073502131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073502131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073502132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073502132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073502132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073502133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073502133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:04.027478 run patchelf(pid=7825): Terminating (SIGINT) 07:35:04.196511 run patchelf(pid=7825): Terminated: ok {rc=0} 07:35:04.318879 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7822): Process ended prematurely: osmo-stp_10.42.42.5(pid=7822) [trial-2356↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7822)] [trial-2356↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 07:35:04.328329 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 07:35:04.355542 run osmo-hlr_10.42.42.2(pid=7816): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7816)] 07:35:04.403302 run osmo-hlr_10.42.42.2(pid=7816): stdout: | (launched: 2022-12-09_07:35:00.710529) 07:35:04.452301 run osmo-hlr_10.42.42.2(pid=7816): stderr: | 20221209073500918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073500918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073500918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073500918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073500918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073500918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073500936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073500952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073500953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073500953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:04.501899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7809): Terminating (SIGTERM) 07:35:04.541551 run iperf3-srv_10.42.42.10(pid=7810): Terminating (SIGTERM) 07:35:04.580859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7811): Terminating (SIGTERM) 07:35:04.620240 run iperf3-srv_10.42.42.10(pid=7812): Terminating (SIGTERM) 07:35:04.659612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7815): Terminating (SIGTERM) 07:35:04.699250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7821): Terminating (SIGTERM) 07:35:04.738859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7824): Terminating (SIGTERM) 07:35:04.778572 --- ParallelTerminationStrategy: PID 7809 died... 07:35:04.797523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7809): Terminated: ok {rc=0} 07:35:04.841658 --- ParallelTerminationStrategy: PID 7810 died... 07:35:04.860129 run iperf3-srv_10.42.42.10(pid=7810): Terminated {rc=256} 07:35:04.903820 --- ParallelTerminationStrategy: PID 7811 died... 07:35:04.922222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7811): Terminated: ok {rc=0} 07:35:04.966043 --- ParallelTerminationStrategy: PID 7812 died... 07:35:04.984427 run iperf3-srv_10.42.42.10(pid=7812): Terminated {rc=256} 07:35:05.028273 --- ParallelTerminationStrategy: PID 7815 died... 07:35:05.046769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7815): Terminated: ok {rc=0} 07:35:05.090627 --- ParallelTerminationStrategy: PID 7821 died... 07:35:05.109128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7821): Terminated: ok {rc=0} 07:35:05.153305 --- ParallelTerminationStrategy: PID 7824 died... 07:35:05.171864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7824): Terminated: ok {rc=0} 07:35:05.255317 bus /gobi_0: Setting Powered False 07:35:06.352313 bus /gobi_0: Setting Powered False 07:35:07.470373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx iperf3.py ---------------------------------------------- 07:35:08.619630 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:08.631628 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:35:08.685072 tst iperf3.py: using LAC 19920 07:35:08.812589 tst iperf3.py: using RAC 30 07:35:08.941328 tst iperf3.py: using CellId 19920 07:35:09.068617 tst iperf3.py: using BVCI 19921 07:35:09.187851 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.199084 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.210024 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.221014 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.231823 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.242692 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.253712 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.264519 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:09.275650 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:09.395347 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:35:09.617095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:09.944814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7826): Launched 07:35:10.228019 run iperf3-srv_10.42.42.10(pid=7827): Launched 07:35:10.349950 tst iperf3.py:8: start network... 07:35:10.569988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:11.074971 run create_hlr_db(pid=7828): Launched 07:35:11.206412 bus /gobi_6: Setting Powered False 07:35:12.270541 run create_hlr_db(pid=7828): Terminated: ok {rc=0} 07:35:12.703591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7830): Launched 07:35:13.007022 run osmo-hlr_10.42.42.2(pid=7831): Launched 07:35:13.122163 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:13.658203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7833): Launched 07:35:13.960022 run osmo-stp_10.42.42.5(pid=7834): Launched 07:35:14.074435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:14.595125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7836): Launched 07:35:14.710484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:14.966170 run patchelf(pid=7837): Launched 07:35:15.134228 run osmo-stp_10.42.42.5(pid=7834): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7834)] 07:35:15.262116 run osmo-stp_10.42.42.5(pid=7834): stdout: | (launched: 2022-12-09_07:35:13.904452) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:15.391785 run osmo-stp_10.42.42.5(pid=7834): stderr: | 20221209073514071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073514072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073514072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073514072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073514073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073514073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073514073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:15.521568 run osmo-stp_10.42.42.5(pid=7834): stdout: | (launched: 2022-12-09_07:35:13.904452) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:15.645559 run osmo-stp_10.42.42.5(pid=7834): stderr: | 20221209073514071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073514072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073514072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073514072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073514073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073514073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073514073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:15.792840 run patchelf(pid=7837): Terminating (SIGINT) 07:35:15.992432 run patchelf(pid=7837): Terminated: ok {rc=0} 07:35:16.125845 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7834): Process ended prematurely: osmo-stp_10.42.42.5(pid=7834) [trial-2356↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7834)] [trial-2356↪gprs:trx-umtrx↪iperf3.py:8] 07:35:16.137230 tst iperf3.py:8: Test FAILED (7.6 sec) 07:35:16.168365 run osmo-hlr_10.42.42.2(pid=7831): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7831)] 07:35:16.220051 run osmo-hlr_10.42.42.2(pid=7831): stdout: | (launched: 2022-12-09_07:35:12.951159) 07:35:16.273364 run osmo-hlr_10.42.42.2(pid=7831): stderr: | 20221209073513123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073513123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073513123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073513123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073513123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073513123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073513138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073513149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073513149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073513149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:16.326460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7826): Terminating (SIGTERM) 07:35:16.370597 run iperf3-srv_10.42.42.10(pid=7827): Terminating (SIGTERM) 07:35:16.416324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7830): Terminating (SIGTERM) 07:35:16.460260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7833): Terminating (SIGTERM) 07:35:16.505201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7836): Terminating (SIGTERM) 07:35:16.551037 --- ParallelTerminationStrategy: PID 7826 died... 07:35:16.572048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7826): Terminated: ok {rc=0} 07:35:16.621846 --- ParallelTerminationStrategy: PID 7827 died... 07:35:16.642220 run iperf3-srv_10.42.42.10(pid=7827): Terminated {rc=256} 07:35:16.689610 --- ParallelTerminationStrategy: PID 7830 died... 07:35:16.710346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7830): Terminated: ok {rc=0} 07:35:16.757635 --- ParallelTerminationStrategy: PID 7833 died... 07:35:16.778739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7833): Terminated: ok {rc=0} 07:35:16.826683 --- ParallelTerminationStrategy: PID 7836 died... 07:35:16.846826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7836): Terminated: ok {rc=0} 07:35:16.936437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 07:35:18.087490 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.099602 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:35:18.150940 tst iperf3m4.py: using LAC 19921 07:35:18.274100 tst iperf3m4.py: using RAC 31 07:35:18.392380 tst iperf3m4.py: using CellId 19921 07:35:18.519584 tst iperf3m4.py: using BVCI 19922 07:35:18.639731 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.651132 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.662281 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.674084 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.685345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.696378 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.707902 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.718923 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:18.730185 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:18.853117 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:18.977692 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:19.095869 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:19.214213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:35:19.419308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:19.725649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7838): Launched 07:35:19.989311 run iperf3-srv_10.42.42.10(pid=7839): Launched 07:35:20.103082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:35:20.307202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:20.613043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7840): Launched 07:35:20.876330 run iperf3-srv_10.42.42.10(pid=7841): Launched 07:35:20.989948 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:35:21.192611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:21.497047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7842): Launched 07:35:21.761384 run iperf3-srv_10.42.42.10(pid=7843): Launched 07:35:21.874748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:35:22.077521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:22.381364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7844): Launched 07:35:22.644121 run iperf3-srv_10.42.42.10(pid=7845): Launched 07:35:22.758405 tst iperf3m4.py:8: start network... 07:35:22.961514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:23.430414 run create_hlr_db(pid=7846): Launched 07:35:23.548572 bus /gobi_6: Setting Powered False 07:35:24.609886 run create_hlr_db(pid=7846): Terminated: ok {rc=0} 07:35:25.054373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7848): Launched 07:35:25.381491 run osmo-hlr_10.42.42.2(pid=7849): Launched 07:35:25.506290 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:26.068492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7851): Launched 07:35:26.394455 run osmo-stp_10.42.42.5(pid=7852): Launched 07:35:26.519416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:27.082370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7854): Launched 07:35:27.207628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:27.483345 run patchelf(pid=7855): Launched 07:35:27.663795 run osmo-stp_10.42.42.5(pid=7852): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7852)] 07:35:27.801779 run osmo-stp_10.42.42.5(pid=7852): stdout: | (launched: 2022-12-09_07:35:26.334992) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:27.940725 run osmo-stp_10.42.42.5(pid=7852): stderr: | 20221209073526521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073526521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073526522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073526522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073526523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073526523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073526523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:28.081315 run osmo-stp_10.42.42.5(pid=7852): stdout: | (launched: 2022-12-09_07:35:26.334992) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:28.214497 run osmo-stp_10.42.42.5(pid=7852): stderr: | 20221209073526521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073526521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073526522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073526522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073526523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073526523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073526523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:28.372150 run patchelf(pid=7855): Terminating (SIGINT) 07:35:28.553795 run patchelf(pid=7855): Terminated: ok {rc=0} 07:35:28.684814 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7852): Process ended prematurely: osmo-stp_10.42.42.5(pid=7852) [trial-2356↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7852)] [trial-2356↪gprs:trx-umtrx↪iperf3m4.py:8] 07:35:28.695451 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:35:28.724351 run osmo-hlr_10.42.42.2(pid=7849): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7849)] 07:35:28.774058 run osmo-hlr_10.42.42.2(pid=7849): stdout: | (launched: 2022-12-09_07:35:25.321879) 07:35:28.825935 run osmo-hlr_10.42.42.2(pid=7849): stderr: | 20221209073525518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073525518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073525518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073525518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073525518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073525518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073525530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073525541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073525541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073525541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:28.877836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7838): Terminating (SIGTERM) 07:35:28.919327 run iperf3-srv_10.42.42.10(pid=7839): Terminating (SIGTERM) 07:35:28.960899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7840): Terminating (SIGTERM) 07:35:29.002690 run iperf3-srv_10.42.42.10(pid=7841): Terminating (SIGTERM) 07:35:29.044252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7842): Terminating (SIGTERM) 07:35:29.085983 run iperf3-srv_10.42.42.10(pid=7843): Terminating (SIGTERM) 07:35:29.127347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7844): Terminating (SIGTERM) 07:35:29.168799 run iperf3-srv_10.42.42.10(pid=7845): Terminating (SIGTERM) 07:35:29.211568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7848): Terminating (SIGTERM) 07:35:29.253526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7851): Terminating (SIGTERM) 07:35:29.295030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7854): Terminating (SIGTERM) 07:35:29.336852 --- ParallelTerminationStrategy: PID 7838 died... 07:35:29.356764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7838): Terminated: ok {rc=0} 07:35:29.402782 --- ParallelTerminationStrategy: PID 7839 died... 07:35:29.422238 run iperf3-srv_10.42.42.10(pid=7839): Terminated {rc=256} 07:35:29.468347 --- ParallelTerminationStrategy: PID 7840 died... 07:35:29.487822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7840): Terminated: ok {rc=0} 07:35:29.533740 --- ParallelTerminationStrategy: PID 7841 died... 07:35:29.553148 run iperf3-srv_10.42.42.10(pid=7841): Terminated {rc=256} 07:35:29.598927 --- ParallelTerminationStrategy: PID 7842 died... 07:35:29.618413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7842): Terminated: ok {rc=0} 07:35:29.664267 --- ParallelTerminationStrategy: PID 7843 died... 07:35:29.683696 run iperf3-srv_10.42.42.10(pid=7843): Terminated {rc=256} 07:35:29.729287 --- ParallelTerminationStrategy: PID 7844 died... 07:35:29.748675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7844): Terminated: ok {rc=0} 07:35:29.794978 --- ParallelTerminationStrategy: PID 7845 died... 07:35:29.814491 run iperf3-srv_10.42.42.10(pid=7845): Terminated {rc=256} 07:35:29.860338 --- ParallelTerminationStrategy: PID 7848 died... 07:35:29.880058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7848): Terminated: ok {rc=0} 07:35:29.925849 --- ParallelTerminationStrategy: PID 7851 died... 07:35:29.945496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7851): Terminated: ok {rc=0} 07:35:29.991380 --- ParallelTerminationStrategy: PID 7854 died... 07:35:30.010966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7854): Terminated: ok {rc=0} 07:35:30.098459 bus /gobi_4: Setting Powered False 07:35:31.195138 bus /gobi_4: Setting Powered False 07:35:32.312506 bus /gobi_1: Setting Powered False 07:35:33.409527 bus /gobi_1: Setting Powered False 07:35:34.527053 bus /gobi_0: Setting Powered False 07:35:35.624482 bus /gobi_0: Setting Powered False 07:35:36.738441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx ping.py ---------------------------------------------- 07:35:37.840555 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:37.852922 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:35:37.904238 tst ping.py: using LAC 19922 07:35:38.031567 tst ping.py: using RAC 32 07:35:38.158634 tst ping.py: using CellId 19922 07:35:38.285728 tst ping.py: using BVCI 19923 07:35:38.395446 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.406338 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.417132 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.428483 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.439824 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.451300 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.462635 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:38.473960 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:38.595230 tst ping.py:19: start network... 07:35:38.812620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:39.310715 run create_hlr_db(pid=7856): Launched 07:35:39.441886 bus /gobi_6: Setting Powered False 07:35:40.506340 run create_hlr_db(pid=7856): Terminated: ok {rc=0} 07:35:40.931798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7858): Launched 07:35:41.229357 run osmo-hlr_10.42.42.2(pid=7859): Launched 07:35:41.342364 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:41.860850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7861): Launched 07:35:42.160439 run osmo-stp_10.42.42.5(pid=7862): Launched 07:35:42.274828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:42.790346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7864): Launched 07:35:42.906953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:43.158717 run patchelf(pid=7865): Launched 07:35:43.324304 run osmo-stp_10.42.42.5(pid=7862): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7862)] 07:35:43.450046 run osmo-stp_10.42.42.5(pid=7862): stdout: | (launched: 2022-12-09_07:35:42.104840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:43.577509 run osmo-stp_10.42.42.5(pid=7862): stderr: | 20221209073542272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073542272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073542272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073542273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073542273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073542273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073542273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:43.705800 run osmo-stp_10.42.42.5(pid=7862): stdout: | (launched: 2022-12-09_07:35:42.104840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:43.828696 run osmo-stp_10.42.42.5(pid=7862): stderr: | 20221209073542272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073542272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073542272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073542273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073542273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073542273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073542273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:43.974334 run patchelf(pid=7865): Terminating (SIGINT) 07:35:44.141604 run patchelf(pid=7865): Terminated: ok {rc=0} 07:35:44.261457 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7862): Process ended prematurely: osmo-stp_10.42.42.5(pid=7862) [trial-2356↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7862)] [trial-2356↪gprs:trx-umtrx↪ping.py:22] 07:35:44.270388 tst ping.py:22: Test FAILED (6.4 sec) 07:35:44.296996 run osmo-hlr_10.42.42.2(pid=7859): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7859)] 07:35:44.344811 run osmo-hlr_10.42.42.2(pid=7859): stdout: | (launched: 2022-12-09_07:35:41.174535) 07:35:44.394207 run osmo-hlr_10.42.42.2(pid=7859): stderr: | 20221209073541345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073541345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073541345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073541345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073541345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073541345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073541357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073541366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073541366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073541366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:44.443950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7858): Terminating (SIGTERM) 07:35:44.483580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7861): Terminating (SIGTERM) 07:35:44.523251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7864): Terminating (SIGTERM) 07:35:44.563151 --- ParallelTerminationStrategy: PID 7858 died... 07:35:44.582118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7858): Terminated: ok {rc=0} 07:35:44.626438 --- ParallelTerminationStrategy: PID 7861 died... 07:35:44.644890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7861): Terminated: ok {rc=0} 07:35:44.688811 --- ParallelTerminationStrategy: PID 7864 died... 07:35:44.707671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7864): Terminated: ok {rc=0} 07:35:44.791231 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 07:35:45.881930 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:45.895095 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:35:45.944538 tst ping_idle_ping.py: using LAC 19923 07:35:46.066304 tst ping_idle_ping.py: using RAC 33 07:35:46.211100 tst ping_idle_ping.py: using CellId 19923 07:35:46.366528 tst ping_idle_ping.py: using BVCI 19924 07:35:46.510931 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.525809 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.542086 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.555040 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.569480 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.582600 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.598646 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:35:46.615121 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:35:46.761285 tst ping_idle_ping.py:24: start network... 07:35:47.018569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:47.529248 run create_hlr_db(pid=7866): Launched 07:35:47.660834 bus /gobi_6: Setting Powered False 07:35:48.724653 run create_hlr_db(pid=7866): Terminated: ok {rc=0} 07:35:49.154848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7868): Launched 07:35:49.456500 run osmo-hlr_10.42.42.2(pid=7869): Launched 07:35:49.572827 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:50.131159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7871): Launched 07:35:50.453960 run osmo-stp_10.42.42.5(pid=7872): Launched 07:35:50.575516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:51.133363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7874): Launched 07:35:51.255090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:51.526708 run patchelf(pid=7875): Launched 07:35:51.705090 run osmo-stp_10.42.42.5(pid=7872): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7872)] 07:35:51.840707 run osmo-stp_10.42.42.5(pid=7872): stdout: | (launched: 2022-12-09_07:35:50.395004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:51.977575 run osmo-stp_10.42.42.5(pid=7872): stderr: | 20221209073550581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073550582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073550582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073550582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073550583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073550583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073550583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:52.114763 run osmo-stp_10.42.42.5(pid=7872): stdout: | (launched: 2022-12-09_07:35:50.395004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:52.246289 run osmo-stp_10.42.42.5(pid=7872): stderr: | 20221209073550581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073550582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073550582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073550582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073550583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073550583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073550583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:52.401918 run patchelf(pid=7875): Terminating (SIGINT) 07:35:52.579592 run patchelf(pid=7875): Terminated: ok {rc=0} 07:35:52.707560 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7872): Process ended prematurely: osmo-stp_10.42.42.5(pid=7872) [trial-2356↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7872)] [trial-2356↪gprs:trx-umtrx↪ping_idle_ping.py:27] 07:35:52.717247 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:35:52.745023 run osmo-hlr_10.42.42.2(pid=7869): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7869)] 07:35:52.794656 run osmo-hlr_10.42.42.2(pid=7869): stdout: | (launched: 2022-12-09_07:35:49.400771) 07:35:52.845998 run osmo-hlr_10.42.42.2(pid=7869): stderr: | 20221209073549574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073549574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073549574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073549574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073549574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073549574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073549585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073549594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073549594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073549594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:52.897553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7868): Terminating (SIGTERM) 07:35:52.938697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7871): Terminating (SIGTERM) 07:35:52.980112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7874): Terminating (SIGTERM) 07:35:53.021913 --- ParallelTerminationStrategy: PID 7868 died... 07:35:53.041835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7868): Terminated: ok {rc=0} 07:35:53.087775 --- ParallelTerminationStrategy: PID 7871 died... 07:35:53.107180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7871): Terminated: ok {rc=0} 07:35:53.152618 --- ParallelTerminationStrategy: PID 7874 died... 07:35:53.172004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7874): Terminated: ok {rc=0} 07:35:53.258686 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 07:35:54.562280 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:35:54.568514 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:35:54.602412 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:35:54.642283 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:35:54.731910 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:35:54.766658 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:35:54.807077 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:35:55.402020 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:35:55.454675 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:55.466290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:35:55.516266 tst cs_paging_gprs_active.py: using LAC 19924 07:35:55.645476 tst cs_paging_gprs_active.py: using RAC 34 07:35:55.771928 tst cs_paging_gprs_active.py: using CellId 19924 07:35:55.898709 tst cs_paging_gprs_active.py: using BVCI 19925 07:35:56.017722 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.029148 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.040299 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.051570 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.062701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.073986 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.085374 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.096460 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:56.108003 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:35:56.227728 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:35:56.348458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:35:56.570702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:56.899741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7879): Launched 07:35:57.183320 run iperf3-srv_10.42.42.10(pid=7880): Launched 07:35:57.306950 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:35:57.527727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:57.857286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7881): Launched 07:35:58.140879 run iperf3-srv_10.42.42.10(pid=7882): Launched 07:35:58.263444 tst cs_paging_gprs_active.py:38: start network... 07:35:58.483158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:58.989965 run create_hlr_db(pid=7883): Launched 07:35:59.123647 bus /gobi_6: Setting Powered False 07:36:00.188140 run create_hlr_db(pid=7883): Terminated: ok {rc=0} 07:36:00.623693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7885): Launched 07:36:00.951861 run osmo-hlr_10.42.42.2(pid=7886): Launched 07:36:01.092354 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:01.911595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7888): Launched 07:36:02.257680 run osmo-stp_10.42.42.5(pid=7889): Launched 07:36:02.390969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:02.929582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7891): Launched 07:36:03.044892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:03.300739 run patchelf(pid=7892): Launched 07:36:03.469559 run osmo-stp_10.42.42.5(pid=7889): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7889)] 07:36:03.597738 run osmo-stp_10.42.42.5(pid=7889): stdout: | (launched: 2022-12-09_07:36:02.192243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:03.727627 run osmo-stp_10.42.42.5(pid=7889): stderr: | 20221209073602431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073602431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073602431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073602432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073602432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073602432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073602432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:03.857891 run osmo-stp_10.42.42.5(pid=7889): stdout: | (launched: 2022-12-09_07:36:02.192243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:03.982475 run osmo-stp_10.42.42.5(pid=7889): stderr: | 20221209073602431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073602431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073602431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073602432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073602432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073602432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073602432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:04.130431 run patchelf(pid=7892): Terminating (SIGINT) 07:36:04.301261 run patchelf(pid=7892): Terminated: ok {rc=0} 07:36:04.424327 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7889): Process ended prematurely: osmo-stp_10.42.42.5(pid=7889) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7889)] [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:36:04.433900 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 07:36:04.461702 run osmo-hlr_10.42.42.2(pid=7886): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7886)] 07:36:04.509460 run osmo-hlr_10.42.42.2(pid=7886): stdout: | (launched: 2022-12-09_07:36:00.890489) 07:36:04.559016 run osmo-hlr_10.42.42.2(pid=7886): stderr: | 20221209073601371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073601372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073601372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073601372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073601372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073601373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073601397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073601419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073601419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073601420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:04.608655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7879): Terminating (SIGTERM) 07:36:04.648557 run iperf3-srv_10.42.42.10(pid=7880): Terminating (SIGTERM) 07:36:04.688304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7881): Terminating (SIGTERM) 07:36:04.728221 run iperf3-srv_10.42.42.10(pid=7882): Terminating (SIGTERM) 07:36:04.768000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7885): Terminating (SIGTERM) 07:36:04.807964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7888): Terminating (SIGTERM) 07:36:04.847842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7891): Terminating (SIGTERM) 07:36:04.887943 --- ParallelTerminationStrategy: PID 7879 died... 07:36:04.907066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7879): Terminated: ok {rc=0} 07:36:04.951535 --- ParallelTerminationStrategy: PID 7880 died... 07:36:04.969922 run iperf3-srv_10.42.42.10(pid=7880): Terminated {rc=256} 07:36:05.013584 --- ParallelTerminationStrategy: PID 7881 died... 07:36:05.032027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7881): Terminated: ok {rc=0} 07:36:05.075672 --- ParallelTerminationStrategy: PID 7882 died... 07:36:05.094082 run iperf3-srv_10.42.42.10(pid=7882): Terminated {rc=256} 07:36:05.137925 --- ParallelTerminationStrategy: PID 7885 died... 07:36:05.156409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7885): Terminated: ok {rc=0} 07:36:05.200896 --- ParallelTerminationStrategy: PID 7888 died... 07:36:05.219736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7888): Terminated: ok {rc=0} 07:36:05.263965 --- ParallelTerminationStrategy: PID 7891 died... 07:36:05.282407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7891): Terminated: ok {rc=0} 07:36:05.367538 bus /gobi_0: Setting Powered False 07:36:06.467281 bus /gobi_0: Setting Powered False 07:36:07.581791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:36:08.732671 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:08.745077 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:36:08.799488 tst iperf3.py: using LAC 19925 07:36:08.926670 tst iperf3.py: using RAC 35 07:36:09.046684 tst iperf3.py: using CellId 19925 07:36:09.164609 tst iperf3.py: using BVCI 19926 07:36:09.284587 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.296344 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.307750 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.319307 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.330594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.342150 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.353606 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.364673 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:09.376054 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:09.494314 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:36:09.699828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:10.005517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7893): Launched 07:36:10.269610 run iperf3-srv_10.42.42.10(pid=7894): Launched 07:36:10.384290 tst iperf3.py:8: start network... 07:36:10.587769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:11.057984 run create_hlr_db(pid=7895): Launched 07:36:11.175169 bus /gobi_6: Setting Powered False 07:36:12.235576 run create_hlr_db(pid=7895): Terminated: ok {rc=0} 07:36:12.679367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7897): Launched 07:36:13.006217 run osmo-hlr_10.42.42.2(pid=7898): Launched 07:36:13.129720 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:13.694878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7900): Launched 07:36:14.022993 run osmo-stp_10.42.42.5(pid=7901): Launched 07:36:14.148600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:14.711080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7903): Launched 07:36:14.835767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:15.111214 run patchelf(pid=7904): Launched 07:36:15.291423 run osmo-stp_10.42.42.5(pid=7901): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7901)] 07:36:15.428565 run osmo-stp_10.42.42.5(pid=7901): stdout: | (launched: 2022-12-09_07:36:13.963050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:15.566976 run osmo-stp_10.42.42.5(pid=7901): stderr: | 20221209073614150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073614150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073614151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073614151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073614152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073614152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073614152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:15.705255 run osmo-stp_10.42.42.5(pid=7901): stdout: | (launched: 2022-12-09_07:36:13.963050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:15.846036 run osmo-stp_10.42.42.5(pid=7901): stderr: | 20221209073614150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073614150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073614151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073614151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073614152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073614152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073614152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:16.015792 run patchelf(pid=7904): Terminating (SIGINT) 07:36:16.203396 run patchelf(pid=7904): Terminated: ok {rc=0} 07:36:16.345885 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7901): Process ended prematurely: osmo-stp_10.42.42.5(pid=7901) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7901)] [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 07:36:16.360728 tst iperf3.py:8: Test FAILED (7.7 sec) 07:36:16.395252 run osmo-hlr_10.42.42.2(pid=7898): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7898)] 07:36:16.455190 run osmo-hlr_10.42.42.2(pid=7898): stdout: | (launched: 2022-12-09_07:36:12.946816) 07:36:16.516246 run osmo-hlr_10.42.42.2(pid=7898): stderr: | 20221209073613139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073613139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073613139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073613139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073613139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073613139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073613151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073613160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073613160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073613160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:16.581092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7893): Terminating (SIGTERM) 07:36:16.625312 run iperf3-srv_10.42.42.10(pid=7894): Terminating (SIGTERM) 07:36:16.673028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7897): Terminating (SIGTERM) 07:36:16.724311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7900): Terminating (SIGTERM) 07:36:16.778318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7903): Terminating (SIGTERM) 07:36:16.831047 --- ParallelTerminationStrategy: PID 7893 died... 07:36:16.853365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7893): Terminated: ok {rc=0} 07:36:16.910746 --- ParallelTerminationStrategy: PID 7894 died... 07:36:16.934192 run iperf3-srv_10.42.42.10(pid=7894): Terminated {rc=256} 07:36:16.981394 --- ParallelTerminationStrategy: PID 7897 died... 07:36:17.002346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7897): Terminated: ok {rc=0} 07:36:17.049626 --- ParallelTerminationStrategy: PID 7900 died... 07:36:17.069596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7900): Terminated: ok {rc=0} 07:36:17.117006 --- ParallelTerminationStrategy: PID 7903 died... 07:36:17.136822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7903): Terminated: ok {rc=0} 07:36:17.226719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:36:18.378695 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.390823 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:36:18.444458 tst iperf3m4.py: using LAC 19926 07:36:18.565769 tst iperf3m4.py: using RAC 36 07:36:18.685478 tst iperf3m4.py: using CellId 19926 07:36:18.804634 tst iperf3m4.py: using BVCI 19927 07:36:18.915228 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.926517 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.937467 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.948877 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.960036 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.971256 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.982760 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:18.994015 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:19.005506 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:19.121980 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:19.247106 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:19.365744 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:19.486063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:36:19.691354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:19.998288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7905): Launched 07:36:20.264463 run iperf3-srv_10.42.42.10(pid=7906): Launched 07:36:20.380905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:36:20.584204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:20.889460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7907): Launched 07:36:21.152506 run iperf3-srv_10.42.42.10(pid=7908): Launched 07:36:21.265698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:36:21.469282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:21.774241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7909): Launched 07:36:22.064071 run iperf3-srv_10.42.42.10(pid=7910): Launched 07:36:22.177496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:36:22.380598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:22.686206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7911): Launched 07:36:22.952786 run iperf3-srv_10.42.42.10(pid=7912): Launched 07:36:23.065954 tst iperf3m4.py:8: start network... 07:36:23.269849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:23.739724 run create_hlr_db(pid=7913): Launched 07:36:23.855520 bus /gobi_6: Setting Powered False 07:36:24.915858 run create_hlr_db(pid=7913): Terminated: ok {rc=0} 07:36:25.338751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7915): Launched 07:36:25.642604 run osmo-hlr_10.42.42.2(pid=7916): Launched 07:36:25.758053 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:26.286090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7918): Launched 07:36:26.588877 run osmo-stp_10.42.42.5(pid=7919): Launched 07:36:26.704280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:27.227776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7921): Launched 07:36:27.344500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:27.601924 run patchelf(pid=7922): Launched 07:36:27.770176 run osmo-stp_10.42.42.5(pid=7919): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7919)] 07:36:27.908756 run osmo-stp_10.42.42.5(pid=7919): stdout: | (launched: 2022-12-09_07:36:26.533095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:28.047642 run osmo-stp_10.42.42.5(pid=7919): stderr: | 20221209073626700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073626700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073626700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073626701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073626701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073626701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073626701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:28.187519 run osmo-stp_10.42.42.5(pid=7919): stdout: | (launched: 2022-12-09_07:36:26.533095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:28.321065 run osmo-stp_10.42.42.5(pid=7919): stderr: | 20221209073626700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073626700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073626700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073626701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073626701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073626701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073626701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:28.480050 run patchelf(pid=7922): Terminating (SIGINT) 07:36:28.661508 run patchelf(pid=7922): Terminated: ok {rc=0} 07:36:28.792571 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7919): Process ended prematurely: osmo-stp_10.42.42.5(pid=7919) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7919)] [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 07:36:28.803299 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:36:28.832919 run osmo-hlr_10.42.42.2(pid=7916): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7916)] 07:36:28.882739 run osmo-hlr_10.42.42.2(pid=7916): stdout: | (launched: 2022-12-09_07:36:25.586434) 07:36:28.933959 run osmo-hlr_10.42.42.2(pid=7916): stderr: | 20221209073625759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073625759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073625759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073625759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073625759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073625759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073625772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073625780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073625781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073625781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:28.985660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7905): Terminating (SIGTERM) 07:36:29.027263 run iperf3-srv_10.42.42.10(pid=7906): Terminating (SIGTERM) 07:36:29.068839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7907): Terminating (SIGTERM) 07:36:29.111050 run iperf3-srv_10.42.42.10(pid=7908): Terminating (SIGTERM) 07:36:29.152829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7909): Terminating (SIGTERM) 07:36:29.194846 run iperf3-srv_10.42.42.10(pid=7910): Terminating (SIGTERM) 07:36:29.236567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7911): Terminating (SIGTERM) 07:36:29.278458 run iperf3-srv_10.42.42.10(pid=7912): Terminating (SIGTERM) 07:36:29.320069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7915): Terminating (SIGTERM) 07:36:29.362101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7918): Terminating (SIGTERM) 07:36:29.403989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7921): Terminating (SIGTERM) 07:36:29.446130 --- ParallelTerminationStrategy: PID 7905 died... 07:36:29.466170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7905): Terminated: ok {rc=0} 07:36:29.512930 --- ParallelTerminationStrategy: PID 7906 died... 07:36:29.532675 run iperf3-srv_10.42.42.10(pid=7906): Terminated {rc=256} 07:36:29.579054 --- ParallelTerminationStrategy: PID 7907 died... 07:36:29.598807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7907): Terminated: ok {rc=0} 07:36:29.645151 --- ParallelTerminationStrategy: PID 7908 died... 07:36:29.664599 run iperf3-srv_10.42.42.10(pid=7908): Terminated {rc=256} 07:36:29.710614 --- ParallelTerminationStrategy: PID 7909 died... 07:36:29.730219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7909): Terminated: ok {rc=0} 07:36:29.776554 --- ParallelTerminationStrategy: PID 7910 died... 07:36:29.796193 run iperf3-srv_10.42.42.10(pid=7910): Terminated {rc=256} 07:36:29.842661 --- ParallelTerminationStrategy: PID 7911 died... 07:36:29.862381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7911): Terminated: ok {rc=0} 07:36:29.908662 --- ParallelTerminationStrategy: PID 7912 died... 07:36:29.928342 run iperf3-srv_10.42.42.10(pid=7912): Terminated {rc=256} 07:36:29.974232 --- ParallelTerminationStrategy: PID 7915 died... 07:36:29.994070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7915): Terminated: ok {rc=0} 07:36:30.040283 --- ParallelTerminationStrategy: PID 7918 died... 07:36:30.060102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7918): Terminated: ok {rc=0} 07:36:30.106469 --- ParallelTerminationStrategy: PID 7921 died... 07:36:30.126153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7921): Terminated: ok {rc=0} 07:36:30.213270 bus /gobi_4: Setting Powered False 07:36:31.309490 bus /gobi_4: Setting Powered False 07:36:32.426763 bus /gobi_1: Setting Powered False 07:36:33.526153 bus /gobi_1: Setting Powered False 07:36:34.641809 bus /gobi_0: Setting Powered False 07:36:35.737165 bus /gobi_0: Setting Powered False 07:36:36.853313 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 07:36:37.955918 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:37.967737 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:36:38.018661 tst ping.py: using LAC 19927 07:36:38.137624 tst ping.py: using RAC 37 07:36:38.270987 tst ping.py: using CellId 19927 07:36:38.396891 tst ping.py: using BVCI 19928 07:36:38.514043 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.525779 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.537448 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.548854 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.560159 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.571293 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.582734 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:38.594005 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:38.713217 tst ping.py:19: start network... 07:36:38.928802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:39.426525 run create_hlr_db(pid=7923): Launched 07:36:39.558573 bus /gobi_6: Setting Powered False 07:36:40.621824 run create_hlr_db(pid=7923): Terminated: ok {rc=0} 07:36:41.049357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7925): Launched 07:36:41.347842 run osmo-hlr_10.42.42.2(pid=7926): Launched 07:36:41.462934 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:41.995906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7928): Launched 07:36:42.295073 run osmo-stp_10.42.42.5(pid=7929): Launched 07:36:42.408662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:42.923072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7931): Launched 07:36:43.038124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:43.290262 run patchelf(pid=7932): Launched 07:36:43.455760 run osmo-stp_10.42.42.5(pid=7929): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7929)] 07:36:43.581483 run osmo-stp_10.42.42.5(pid=7929): stdout: | (launched: 2022-12-09_07:36:42.239852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:43.709188 run osmo-stp_10.42.42.5(pid=7929): stderr: | 20221209073642408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073642408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073642409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073642409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073642410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073642410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073642410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:43.837135 run osmo-stp_10.42.42.5(pid=7929): stdout: | (launched: 2022-12-09_07:36:42.239852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:43.959283 run osmo-stp_10.42.42.5(pid=7929): stderr: | 20221209073642408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073642408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073642409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073642409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073642410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073642410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073642410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:44.103811 run patchelf(pid=7932): Terminating (SIGINT) 07:36:44.270167 run patchelf(pid=7932): Terminated: ok {rc=0} 07:36:44.390000 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7929): Process ended prematurely: osmo-stp_10.42.42.5(pid=7929) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7929)] [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 07:36:44.398858 tst ping.py:22: Test FAILED (6.4 sec) 07:36:44.425951 run osmo-hlr_10.42.42.2(pid=7926): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7926)] 07:36:44.473802 run osmo-hlr_10.42.42.2(pid=7926): stdout: | (launched: 2022-12-09_07:36:41.292477) 07:36:44.523171 run osmo-hlr_10.42.42.2(pid=7926): stderr: | 20221209073641463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073641464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073641464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073641464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073641464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073641464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073641476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073641485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073641485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073641485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:44.573445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7925): Terminating (SIGTERM) 07:36:44.613306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7928): Terminating (SIGTERM) 07:36:44.653208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7931): Terminating (SIGTERM) 07:36:44.693338 --- ParallelTerminationStrategy: PID 7925 died... 07:36:44.712313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7925): Terminated: ok {rc=0} 07:36:44.756475 --- ParallelTerminationStrategy: PID 7928 died... 07:36:44.774988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7928): Terminated: ok {rc=0} 07:36:44.819053 --- ParallelTerminationStrategy: PID 7931 died... 07:36:44.837597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7931): Terminated: ok {rc=0} 07:36:44.920419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:36:46.006548 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.023128 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:36:46.084794 tst ping_idle_ping.py: using LAC 19928 07:36:46.213980 tst ping_idle_ping.py: using RAC 38 07:36:46.333513 tst ping_idle_ping.py: using CellId 19928 07:36:46.453498 tst ping_idle_ping.py: using BVCI 19929 07:36:46.595964 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.609270 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.622018 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.635282 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.648340 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.660527 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.673821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:36:46.686355 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:36:46.808821 tst ping_idle_ping.py:24: start network... 07:36:47.014555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:47.486031 run create_hlr_db(pid=7933): Launched 07:36:47.600744 bus /gobi_6: Setting Powered False 07:36:48.661346 run create_hlr_db(pid=7933): Terminated: ok {rc=0} 07:36:49.079776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7935): Launched 07:36:49.381576 run osmo-hlr_10.42.42.2(pid=7936): Launched 07:36:49.496365 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:50.023548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7938): Launched 07:36:50.323472 run osmo-stp_10.42.42.5(pid=7939): Launched 07:36:50.438129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:50.955456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7941): Launched 07:36:51.069957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:51.324149 run patchelf(pid=7942): Launched 07:36:51.491769 run osmo-stp_10.42.42.5(pid=7939): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7939)] 07:36:51.618827 run osmo-stp_10.42.42.5(pid=7939): stdout: | (launched: 2022-12-09_07:36:50.268258) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:51.747349 run osmo-stp_10.42.42.5(pid=7939): stderr: | 20221209073650435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073650435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073650435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073650436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073650436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073650436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073650436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:51.875851 run osmo-stp_10.42.42.5(pid=7939): stdout: | (launched: 2022-12-09_07:36:50.268258) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:51.998929 run osmo-stp_10.42.42.5(pid=7939): stderr: | 20221209073650435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073650435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073650435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073650436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073650436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073650436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073650436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:52.144412 run patchelf(pid=7942): Terminating (SIGINT) 07:36:52.312494 run patchelf(pid=7942): Terminated: ok {rc=0} 07:36:52.434012 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7939): Process ended prematurely: osmo-stp_10.42.42.5(pid=7939) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7939)] [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 07:36:52.443182 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:36:52.470748 run osmo-hlr_10.42.42.2(pid=7936): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7936)] 07:36:52.518888 run osmo-hlr_10.42.42.2(pid=7936): stdout: | (launched: 2022-12-09_07:36:49.325392) 07:36:52.568789 run osmo-hlr_10.42.42.2(pid=7936): stderr: | 20221209073649500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073649500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073649500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073649500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073649500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073649500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073649512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073649521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073649521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073649521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:52.619323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7935): Terminating (SIGTERM) 07:36:52.659837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7938): Terminating (SIGTERM) 07:36:52.700142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7941): Terminating (SIGTERM) 07:36:52.740673 --- ParallelTerminationStrategy: PID 7935 died... 07:36:52.759932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7935): Terminated: ok {rc=0} 07:36:52.804650 --- ParallelTerminationStrategy: PID 7938 died... 07:36:52.823539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7938): Terminated: ok {rc=0} 07:36:52.867762 --- ParallelTerminationStrategy: PID 7941 died... 07:36:52.886533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7941): Terminated: ok {rc=0} 07:36:52.972177 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:36:54.280173 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:36:54.286722 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:36:54.320579 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:36:54.360638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:36:54.450294 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:36:54.484104 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:36:54.524204 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:36:55.121215 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:36:55.173610 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.185032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:36:55.256486 tst cs_paging_gprs_active.py: using LAC 19929 07:36:55.386324 tst cs_paging_gprs_active.py: using RAC 39 07:36:55.517494 tst cs_paging_gprs_active.py: using CellId 19929 07:36:55.646165 tst cs_paging_gprs_active.py: using BVCI 19930 07:36:55.764583 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.776058 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.787329 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.798608 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.809872 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.821212 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.832918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.844244 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:55.855654 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:36:55.975119 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:36:56.091635 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:36:56.297832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:56.605754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7946): Launched 07:36:56.871232 run iperf3-srv_10.42.42.10(pid=7947): Launched 07:36:56.985573 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:36:57.190098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:57.517430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7948): Launched 07:36:57.801166 run iperf3-srv_10.42.42.10(pid=7949): Launched 07:36:57.923416 tst cs_paging_gprs_active.py:38: start network... 07:36:58.144768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:58.652057 run create_hlr_db(pid=7950): Launched 07:36:58.784277 bus /gobi_6: Setting Powered False 07:36:59.850275 run create_hlr_db(pid=7950): Terminated: ok {rc=0} 07:37:00.286588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Launched 07:37:00.593114 run osmo-hlr_10.42.42.2(pid=7953): Launched 07:37:00.709310 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:01.304432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Launched 07:37:01.625839 run osmo-stp_10.42.42.5(pid=7956): Launched 07:37:01.793363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:02.511965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7958): Launched 07:37:02.627854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:02.895020 run patchelf(pid=7959): Launched 07:37:03.064721 run osmo-stp_10.42.42.5(pid=7956): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] 07:37:03.193784 run osmo-stp_10.42.42.5(pid=7956): stdout: | (launched: 2022-12-09_07:37:01.568638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:03.324172 run osmo-stp_10.42.42.5(pid=7956): stderr: | 20221209073701918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073701918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073701918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073701918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073701919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073701919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073701919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:03.454979 run osmo-stp_10.42.42.5(pid=7956): stdout: | (launched: 2022-12-09_07:37:01.568638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:03.579937 run osmo-stp_10.42.42.5(pid=7956): stderr: | 20221209073701918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073701918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073701918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073701918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073701919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073701919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073701919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:03.728801 run patchelf(pid=7959): Terminating (SIGINT) 07:37:03.899492 run patchelf(pid=7959): Terminated: ok {rc=0} 07:37:04.022860 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7956): Process ended prematurely: osmo-stp_10.42.42.5(pid=7956) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:37:04.032407 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 07:37:04.060057 run osmo-hlr_10.42.42.2(pid=7953): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7953)] 07:37:04.107942 run osmo-hlr_10.42.42.2(pid=7953): stdout: | (launched: 2022-12-09_07:37:00.536618) 07:37:04.157249 run osmo-hlr_10.42.42.2(pid=7953): stderr: | 20221209073700711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073700711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073700711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073700711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073700711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073700711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073700724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073700733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073700733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073700733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:04.207137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7946): Terminating (SIGTERM) 07:37:04.246675 run iperf3-srv_10.42.42.10(pid=7947): Terminating (SIGTERM) 07:37:04.286033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7948): Terminating (SIGTERM) 07:37:04.325726 run iperf3-srv_10.42.42.10(pid=7949): Terminating (SIGTERM) 07:37:04.365313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Terminating (SIGTERM) 07:37:04.405579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Terminating (SIGTERM) 07:37:04.445228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7958): Terminating (SIGTERM) 07:37:04.485141 --- ParallelTerminationStrategy: PID 7946 died... 07:37:04.504071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7946): Terminated: ok {rc=0} 07:37:04.548880 --- ParallelTerminationStrategy: PID 7947 died... 07:37:04.567744 run iperf3-srv_10.42.42.10(pid=7947): Terminated {rc=256} 07:37:04.611787 --- ParallelTerminationStrategy: PID 7948 died... 07:37:04.630521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7948): Terminated: ok {rc=0} 07:37:04.674532 --- ParallelTerminationStrategy: PID 7949 died... 07:37:04.693072 run iperf3-srv_10.42.42.10(pid=7949): Terminated {rc=256} 07:37:04.737635 --- ParallelTerminationStrategy: PID 7952 died... 07:37:04.756391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Terminated: ok {rc=0} 07:37:04.800556 --- ParallelTerminationStrategy: PID 7955 died... 07:37:04.819153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Terminated: ok {rc=0} 07:37:04.863236 --- ParallelTerminationStrategy: PID 7958 died... 07:37:04.881919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7958): Terminated: ok {rc=0} 07:37:04.967087 bus /gobi_0: Setting Powered False 07:37:06.066517 bus /gobi_0: Setting Powered False 07:37:07.182337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:37:08.327963 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.339747 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:37:08.409788 tst iperf3.py: using LAC 19930 07:37:08.530175 tst iperf3.py: using RAC 40 07:37:08.650920 tst iperf3.py: using CellId 19930 07:37:08.772222 tst iperf3.py: using BVCI 19931 07:37:08.882440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.893484 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.904233 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.915194 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.926060 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.937044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.948093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.959121 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:08.970541 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:09.088377 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:37:09.292891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:09.598599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7960): Launched 07:37:09.862667 run iperf3-srv_10.42.42.10(pid=7961): Launched 07:37:09.976166 tst iperf3.py:8: start network... 07:37:10.179595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:10.648265 run create_hlr_db(pid=7962): Launched 07:37:10.763125 bus /gobi_6: Setting Powered False 07:37:11.823031 run create_hlr_db(pid=7962): Terminated: ok {rc=0} 07:37:12.244703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7964): Launched 07:37:12.548307 run osmo-hlr_10.42.42.2(pid=7965): Launched 07:37:12.663332 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:13.294084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7967): Launched 07:37:13.590905 run osmo-stp_10.42.42.5(pid=7968): Launched 07:37:13.704384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:14.218298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Launched 07:37:14.332209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:14.584298 run patchelf(pid=7971): Launched 07:37:14.749431 run osmo-stp_10.42.42.5(pid=7968): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7968)] 07:37:14.875847 run osmo-stp_10.42.42.5(pid=7968): stdout: | (launched: 2022-12-09_07:37:13.535757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:15.003430 run osmo-stp_10.42.42.5(pid=7968): stderr: | 20221209073713702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073713702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073713703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073713703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073713703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073713704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073713704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:15.130907 run osmo-stp_10.42.42.5(pid=7968): stdout: | (launched: 2022-12-09_07:37:13.535757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:15.252649 run osmo-stp_10.42.42.5(pid=7968): stderr: | 20221209073713702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073713702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073713703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073713703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073713703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073713704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073713704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:15.397583 run patchelf(pid=7971): Terminating (SIGINT) 07:37:15.563797 run patchelf(pid=7971): Terminated: ok {rc=0} 07:37:15.684012 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7968): Process ended prematurely: osmo-stp_10.42.42.5(pid=7968) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7968)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 07:37:15.693735 tst iperf3.py:8: Test FAILED (7.4 sec) 07:37:15.721244 run osmo-hlr_10.42.42.2(pid=7965): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7965)] 07:37:15.769286 run osmo-hlr_10.42.42.2(pid=7965): stdout: | (launched: 2022-12-09_07:37:12.492188) 07:37:15.818578 run osmo-hlr_10.42.42.2(pid=7965): stderr: | 20221209073712666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073712666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073712666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073712666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073712666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073712666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073712681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073712691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073712691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073712692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:15.870900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7960): Terminating (SIGTERM) 07:37:15.916528 run iperf3-srv_10.42.42.10(pid=7961): Terminating (SIGTERM) 07:37:15.961030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7964): Terminating (SIGTERM) 07:37:16.003735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7967): Terminating (SIGTERM) 07:37:16.047200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Terminating (SIGTERM) 07:37:16.089555 --- ParallelTerminationStrategy: PID 7960 died... 07:37:16.109214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7960): Terminated: ok {rc=0} 07:37:16.155977 --- ParallelTerminationStrategy: PID 7961 died... 07:37:16.175715 run iperf3-srv_10.42.42.10(pid=7961): Terminated {rc=256} 07:37:16.222555 --- ParallelTerminationStrategy: PID 7964 died... 07:37:16.242320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7964): Terminated: ok {rc=0} 07:37:16.289422 --- ParallelTerminationStrategy: PID 7967 died... 07:37:16.308891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7967): Terminated: ok {rc=0} 07:37:16.355877 --- ParallelTerminationStrategy: PID 7970 died... 07:37:16.375411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Terminated: ok {rc=0} 07:37:16.462611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:37:17.605016 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:17.616771 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:37:17.686430 tst iperf3m4.py: using LAC 19931 07:37:17.804010 tst iperf3m4.py: using RAC 41 07:37:17.925203 tst iperf3m4.py: using CellId 19931 07:37:18.041741 tst iperf3m4.py: using BVCI 19932 07:37:18.158749 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.170395 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.181842 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.193721 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.205579 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.217534 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.229584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.241318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:18.253079 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:18.371324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:18.488487 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:18.609473 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:18.726983 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:37:18.925998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:19.222926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7972): Launched 07:37:19.480744 run iperf3-srv_10.42.42.10(pid=7973): Launched 07:37:19.591625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:37:19.790184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:20.088716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7974): Launched 07:37:20.347524 run iperf3-srv_10.42.42.10(pid=7975): Launched 07:37:20.458225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:37:20.656472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:20.955009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7976): Launched 07:37:21.213140 run iperf3-srv_10.42.42.10(pid=7977): Launched 07:37:21.323744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:37:21.521712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:21.818742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7978): Launched 07:37:22.076117 run iperf3-srv_10.42.42.10(pid=7979): Launched 07:37:22.187217 tst iperf3m4.py:8: start network... 07:37:22.385207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:22.846543 run create_hlr_db(pid=7980): Launched 07:37:22.960519 bus /gobi_6: Setting Powered False 07:37:24.019855 run create_hlr_db(pid=7980): Terminated: ok {rc=0} 07:37:24.454302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7982): Launched 07:37:24.773181 run osmo-hlr_10.42.42.2(pid=7983): Launched 07:37:24.894579 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:25.440847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7985): Launched 07:37:25.758152 run osmo-stp_10.42.42.5(pid=7986): Launched 07:37:25.881664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:26.429110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7988): Launched 07:37:26.551434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:26.820835 run patchelf(pid=7989): Launched 07:37:26.997575 run osmo-stp_10.42.42.5(pid=7986): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7986)] 07:37:27.131523 run osmo-stp_10.42.42.5(pid=7986): stdout: | (launched: 2022-12-09_07:37:25.700172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:27.267439 run osmo-stp_10.42.42.5(pid=7986): stderr: | 20221209073725885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073725885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073725886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073725886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073725886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073725886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073725887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:27.403010 run osmo-stp_10.42.42.5(pid=7986): stdout: | (launched: 2022-12-09_07:37:25.700172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:27.532790 run osmo-stp_10.42.42.5(pid=7986): stderr: | 20221209073725885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073725885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073725886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073725886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073725886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073725886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073725887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:27.686688 run patchelf(pid=7989): Terminating (SIGINT) 07:37:27.863381 run patchelf(pid=7989): Terminated: ok {rc=0} 07:37:27.990676 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7986): Process ended prematurely: osmo-stp_10.42.42.5(pid=7986) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7986)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:37:28.000832 tst iperf3m4.py:8: Test FAILED (10.4 sec) 07:37:28.029339 run osmo-hlr_10.42.42.2(pid=7983): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7983)] 07:37:28.078786 run osmo-hlr_10.42.42.2(pid=7983): stdout: | (launched: 2022-12-09_07:37:24.715007) 07:37:28.130149 run osmo-hlr_10.42.42.2(pid=7983): stderr: | 20221209073724909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073724910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073724910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073724910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073724910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073724911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073724923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073724933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073724933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073724934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:28.181802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7972): Terminating (SIGTERM) 07:37:28.222879 run iperf3-srv_10.42.42.10(pid=7973): Terminating (SIGTERM) 07:37:28.264071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7974): Terminating (SIGTERM) 07:37:28.305577 run iperf3-srv_10.42.42.10(pid=7975): Terminating (SIGTERM) 07:37:28.346938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7976): Terminating (SIGTERM) 07:37:28.388370 run iperf3-srv_10.42.42.10(pid=7977): Terminating (SIGTERM) 07:37:28.429639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7978): Terminating (SIGTERM) 07:37:28.471119 run iperf3-srv_10.42.42.10(pid=7979): Terminating (SIGTERM) 07:37:28.512192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7982): Terminating (SIGTERM) 07:37:28.553818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7985): Terminating (SIGTERM) 07:37:28.595173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7988): Terminating (SIGTERM) 07:37:28.636775 --- ParallelTerminationStrategy: PID 7972 died... 07:37:28.656586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7972): Terminated: ok {rc=0} 07:37:28.702472 --- ParallelTerminationStrategy: PID 7973 died... 07:37:28.721844 run iperf3-srv_10.42.42.10(pid=7973): Terminated {rc=256} 07:37:28.767297 --- ParallelTerminationStrategy: PID 7974 died... 07:37:28.786671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7974): Terminated: ok {rc=0} 07:37:28.832325 --- ParallelTerminationStrategy: PID 7975 died... 07:37:28.852180 run iperf3-srv_10.42.42.10(pid=7975): Terminated {rc=256} 07:37:28.897801 --- ParallelTerminationStrategy: PID 7976 died... 07:37:28.917404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7976): Terminated: ok {rc=0} 07:37:28.963323 --- ParallelTerminationStrategy: PID 7977 died... 07:37:28.982640 run iperf3-srv_10.42.42.10(pid=7977): Terminated {rc=256} 07:37:29.028256 --- ParallelTerminationStrategy: PID 7978 died... 07:37:29.047653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7978): Terminated: ok {rc=0} 07:37:29.093194 --- ParallelTerminationStrategy: PID 7979 died... 07:37:29.112498 run iperf3-srv_10.42.42.10(pid=7979): Terminated {rc=256} 07:37:29.158201 --- ParallelTerminationStrategy: PID 7982 died... 07:37:29.177486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7982): Terminated: ok {rc=0} 07:37:29.222873 --- ParallelTerminationStrategy: PID 7985 died... 07:37:29.242136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7985): Terminated: ok {rc=0} 07:37:29.287628 --- ParallelTerminationStrategy: PID 7988 died... 07:37:29.307026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7988): Terminated: ok {rc=0} 07:37:29.393523 bus /gobi_4: Setting Powered False 07:37:30.491640 bus /gobi_4: Setting Powered False 07:37:31.613601 bus /gobi_1: Setting Powered False 07:37:32.720119 bus /gobi_1: Setting Powered False 07:37:33.832739 bus /gobi_0: Setting Powered False 07:37:34.929713 bus /gobi_0: Setting Powered False 07:37:36.048296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:37:37.153473 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.165669 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:37:37.237780 tst ping.py: using LAC 19932 07:37:37.355498 tst ping.py: using RAC 42 07:37:37.480812 tst ping.py: using CellId 19932 07:37:37.606471 tst ping.py: using BVCI 19933 07:37:37.722340 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.734096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.745644 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.756936 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.768287 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.779765 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.791289 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:37.802836 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:37.919323 tst ping.py:19: start network... 07:37:38.115592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:38.574721 run create_hlr_db(pid=7991): Launched 07:37:38.689702 bus /gobi_6: Setting Powered False 07:37:39.748207 run create_hlr_db(pid=7991): Terminated: ok {rc=0} 07:37:40.178029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7993): Launched 07:37:40.494528 run osmo-hlr_10.42.42.2(pid=7994): Launched 07:37:40.613889 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:41.164157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7996): Launched 07:37:41.477679 run osmo-stp_10.42.42.5(pid=7997): Launched 07:37:41.597469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:42.140292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7999): Launched 07:37:42.260487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:42.525912 run patchelf(pid=8000): Launched 07:37:42.700010 run osmo-stp_10.42.42.5(pid=7997): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7997)] 07:37:42.833060 run osmo-stp_10.42.42.5(pid=7997): stdout: | (launched: 2022-12-09_07:37:41.419608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:42.967993 run osmo-stp_10.42.42.5(pid=7997): stderr: | 20221209073741608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073741608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073741609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073741609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073741610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073741610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073741610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:43.103258 run osmo-stp_10.42.42.5(pid=7997): stdout: | (launched: 2022-12-09_07:37:41.419608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:43.232027 run osmo-stp_10.42.42.5(pid=7997): stderr: | 20221209073741608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073741608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073741609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073741609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073741610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073741610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073741610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:43.384382 run patchelf(pid=8000): Terminating (SIGINT) 07:37:43.558719 run patchelf(pid=8000): Terminated: ok {rc=0} 07:37:43.684149 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7997): Process ended prematurely: osmo-stp_10.42.42.5(pid=7997) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7997)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 07:37:43.693931 tst ping.py:22: Test FAILED (6.5 sec) 07:37:43.721543 run osmo-hlr_10.42.42.2(pid=7994): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7994)] 07:37:43.771228 run osmo-hlr_10.42.42.2(pid=7994): stdout: | (launched: 2022-12-09_07:37:40.435822) 07:37:43.822864 run osmo-hlr_10.42.42.2(pid=7994): stderr: | 20221209073740630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073740630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073740630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073740630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073740631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073740631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073740643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073740651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073740651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073740652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:43.874883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7993): Terminating (SIGTERM) 07:37:43.916144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7996): Terminating (SIGTERM) 07:37:43.957479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7999): Terminating (SIGTERM) 07:37:43.999350 --- ParallelTerminationStrategy: PID 7993 died... 07:37:44.019143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7993): Terminated: ok {rc=0} 07:37:44.064913 --- ParallelTerminationStrategy: PID 7996 died... 07:37:44.084367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7996): Terminated: ok {rc=0} 07:37:44.129735 --- ParallelTerminationStrategy: PID 7999 died... 07:37:44.149236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7999): Terminated: ok {rc=0} 07:37:44.237590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:37:45.322908 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.335709 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:37:45.410243 tst ping_idle_ping.py: using LAC 19933 07:37:45.534783 tst ping_idle_ping.py: using RAC 43 07:37:45.660873 tst ping_idle_ping.py: using CellId 19933 07:37:45.786174 tst ping_idle_ping.py: using BVCI 19934 07:37:45.922794 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.934858 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.946749 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.958643 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.970572 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.982462 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:45.994624 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:37:46.009374 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:37:46.136012 tst ping_idle_ping.py:24: start network... 07:37:46.344779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:46.824506 run create_hlr_db(pid=8001): Launched 07:37:46.979847 bus /gobi_6: Setting Powered False 07:37:48.038655 run create_hlr_db(pid=8001): Terminated: ok {rc=0} 07:37:48.449515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8003): Launched 07:37:48.742545 run osmo-hlr_10.42.42.2(pid=8004): Launched 07:37:48.854324 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:49.371490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8006): Launched 07:37:49.666784 run osmo-stp_10.42.42.5(pid=8007): Launched 07:37:49.779950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:50.287363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8009): Launched 07:37:50.399003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:50.647594 run patchelf(pid=8010): Launched 07:37:50.810748 run osmo-stp_10.42.42.5(pid=8007): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8007)] 07:37:50.935770 run osmo-stp_10.42.42.5(pid=8007): stdout: | (launched: 2022-12-09_07:37:49.612272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:51.062320 run osmo-stp_10.42.42.5(pid=8007): stderr: | 20221209073749778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073749778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073749778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073749779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073749779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073749779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073749779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:51.189219 run osmo-stp_10.42.42.5(pid=8007): stdout: | (launched: 2022-12-09_07:37:49.612272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:51.310088 run osmo-stp_10.42.42.5(pid=8007): stderr: | 20221209073749778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073749778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073749778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073749779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073749779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073749779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073749779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:51.453871 run patchelf(pid=8010): Terminating (SIGINT) 07:37:51.618454 run patchelf(pid=8010): Terminated: ok {rc=0} 07:37:51.737398 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8007): Process ended prematurely: osmo-stp_10.42.42.5(pid=8007) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8007)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:37:51.746463 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:37:51.772642 run osmo-hlr_10.42.42.2(pid=8004): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8004)] 07:37:51.820131 run osmo-hlr_10.42.42.2(pid=8004): stdout: | (launched: 2022-12-09_07:37:48.688606) 07:37:51.869298 run osmo-hlr_10.42.42.2(pid=8004): stderr: | 20221209073748859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073748859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073748859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073748859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073748859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073748859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073748874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073748885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073748885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073748885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:51.918619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8003): Terminating (SIGTERM) 07:37:51.958187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8006): Terminating (SIGTERM) 07:37:51.997375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8009): Terminating (SIGTERM) 07:37:52.037324 --- ParallelTerminationStrategy: PID 8003 died... 07:37:52.056127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8003): Terminated: ok {rc=0} 07:37:52.100428 --- ParallelTerminationStrategy: PID 8006 died... 07:37:52.119167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8006): Terminated: ok {rc=0} 07:37:52.162971 --- ParallelTerminationStrategy: PID 8009 died... 07:37:52.182189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8009): Terminated: ok {rc=0} 07:37:52.265146 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:37:53.576733 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:37:53.583515 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:37:53.617379 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:37:53.658096 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:37:53.749603 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:37:53.783555 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:37:53.823956 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:37:54.421386 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:37:54.473021 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:54.484651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:37:54.557483 tst cs_paging_gprs_active.py: using LAC 19934 07:37:54.684096 tst cs_paging_gprs_active.py: using RAC 44 07:37:54.811478 tst cs_paging_gprs_active.py: using CellId 19934 07:37:54.939248 tst cs_paging_gprs_active.py: using BVCI 19935 07:37:55.055584 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.067356 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.078960 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.090548 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.102065 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.113880 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.125771 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.137433 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:55.149285 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:37:55.269492 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:37:55.393569 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:37:55.610617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:55.933639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8014): Launched 07:37:56.211662 run iperf3-srv_10.42.42.10(pid=8015): Launched 07:37:56.331684 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:37:56.547768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:56.870765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8016): Launched 07:37:57.151024 run iperf3-srv_10.42.42.10(pid=8017): Launched 07:37:57.270961 tst cs_paging_gprs_active.py:38: start network... 07:37:57.486923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:57.984396 run create_hlr_db(pid=8018): Launched 07:37:58.115429 bus /gobi_6: Setting Powered False 07:37:59.178769 run create_hlr_db(pid=8018): Terminated: ok {rc=0} 07:37:59.609674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8020): Launched 07:37:59.910287 run osmo-hlr_10.42.42.2(pid=8021): Launched 07:38:00.022993 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:00.556317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8023): Launched 07:38:00.856639 run osmo-stp_10.42.42.5(pid=8024): Launched 07:38:01.076507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:01.738820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8042): Launched 07:38:01.896698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:02.206707 run patchelf(pid=8063): Launched 07:38:02.401269 run osmo-stp_10.42.42.5(pid=8024): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8024)] 07:38:02.556800 run osmo-stp_10.42.42.5(pid=8024): stdout: | (launched: 2022-12-09_07:38:00.800036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:02.727935 run osmo-stp_10.42.42.5(pid=8024): stderr: | 20221209073801116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073801116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073801117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073801124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073801124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073801124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073801124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:02.869405 run osmo-stp_10.42.42.5(pid=8024): stdout: | (launched: 2022-12-09_07:38:00.800036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:03.015158 run osmo-stp_10.42.42.5(pid=8024): stderr: | 20221209073801116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073801116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073801117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073801124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073801124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073801124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073801124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:03.186416 run patchelf(pid=8063): Terminating (SIGINT) 07:38:03.384193 run patchelf(pid=8063): Terminated: ok {rc=0} 07:38:03.537960 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8024): Process ended prematurely: osmo-stp_10.42.42.5(pid=8024) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8024)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:38:03.549869 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 07:38:03.583668 run osmo-hlr_10.42.42.2(pid=8021): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8021)] 07:38:03.645709 run osmo-hlr_10.42.42.2(pid=8021): stdout: | (launched: 2022-12-09_07:37:59.854925) 07:38:03.710406 run osmo-hlr_10.42.42.2(pid=8021): stderr: | 20221209073800027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073800027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073800027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073800027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073800027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073800027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073800039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073800050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073800050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073800050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:03.776067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8014): Terminating (SIGTERM) 07:38:03.831466 run iperf3-srv_10.42.42.10(pid=8015): Terminating (SIGTERM) 07:38:03.883985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8016): Terminating (SIGTERM) 07:38:03.940779 run iperf3-srv_10.42.42.10(pid=8017): Terminating (SIGTERM) 07:38:03.997024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8020): Terminating (SIGTERM) 07:38:04.054947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8023): Terminating (SIGTERM) 07:38:04.110413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8042): Terminating (SIGTERM) 07:38:04.163877 --- ParallelTerminationStrategy: PID 8014 died... 07:38:04.190378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8014): Terminated: ok {rc=0} 07:38:04.251039 --- ParallelTerminationStrategy: PID 8015 died... 07:38:04.276180 run iperf3-srv_10.42.42.10(pid=8015): Terminated {rc=256} 07:38:04.332798 --- ParallelTerminationStrategy: PID 8016 died... 07:38:04.358878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8016): Terminated: ok {rc=0} 07:38:04.420110 --- ParallelTerminationStrategy: PID 8017 died... 07:38:04.448764 run iperf3-srv_10.42.42.10(pid=8017): Terminated {rc=256} 07:38:04.506955 --- ParallelTerminationStrategy: PID 8020 died... 07:38:04.528626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8020): Terminated: ok {rc=0} 07:38:04.580192 --- ParallelTerminationStrategy: PID 8023 died... 07:38:04.608381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8023): Terminated: ok {rc=0} 07:38:04.671939 --- ParallelTerminationStrategy: PID 8042 died... 07:38:04.692065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8042): Terminated: ok {rc=0} 07:38:04.807661 bus /gobi_0: Setting Powered False 07:38:05.928187 bus /gobi_0: Setting Powered False 07:38:07.043544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:38:08.189136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.201766 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:38:08.274056 tst iperf3.py: using LAC 19935 07:38:08.396422 tst iperf3.py: using RAC 45 07:38:08.519042 tst iperf3.py: using CellId 19935 07:38:08.641306 tst iperf3.py: using BVCI 19936 07:38:08.753234 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.765116 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.776813 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.788916 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.800556 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.814850 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.826702 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.838621 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:08.850513 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:08.974644 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:38:09.183478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:09.493189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8299): Launched 07:38:09.778581 run iperf3-srv_10.42.42.10(pid=8300): Launched 07:38:09.907659 tst iperf3.py:8: start network... 07:38:10.115206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:10.599047 run create_hlr_db(pid=8301): Launched 07:38:10.759843 bus /gobi_6: Setting Powered False 07:38:11.822546 run create_hlr_db(pid=8301): Terminated: ok {rc=0} 07:38:12.257247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8303): Launched 07:38:12.578245 run osmo-hlr_10.42.42.2(pid=8304): Launched 07:38:12.811037 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:13.517246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8306): Launched 07:38:13.842366 run osmo-stp_10.42.42.5(pid=8307): Launched 07:38:14.075532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:14.749331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8309): Launched 07:38:14.880302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:15.142679 run patchelf(pid=8310): Launched 07:38:15.331726 run osmo-stp_10.42.42.5(pid=8307): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8307)] 07:38:15.463384 run osmo-stp_10.42.42.5(pid=8307): stdout: | (launched: 2022-12-09_07:38:13.781369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:15.598761 run osmo-stp_10.42.42.5(pid=8307): stderr: | 20221209073814106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073814106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073814106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073814106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073814107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073814107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073814107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:15.733494 run osmo-stp_10.42.42.5(pid=8307): stdout: | (launched: 2022-12-09_07:38:13.781369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:15.886388 run osmo-stp_10.42.42.5(pid=8307): stderr: | 20221209073814106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073814106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073814106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073814106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073814107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073814107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073814107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:16.063212 run patchelf(pid=8310): Terminating (SIGINT) 07:38:16.254937 run patchelf(pid=8310): Terminated: ok {rc=0} 07:38:16.416006 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8307): Process ended prematurely: osmo-stp_10.42.42.5(pid=8307) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8307)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 07:38:16.428708 tst iperf3.py:8: Test FAILED (8.3 sec) 07:38:16.461951 run osmo-hlr_10.42.42.2(pid=8304): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8304)] 07:38:16.518546 run osmo-hlr_10.42.42.2(pid=8304): stdout: | (launched: 2022-12-09_07:38:12.521267) 07:38:16.577338 run osmo-hlr_10.42.42.2(pid=8304): stderr: | 20221209073812858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073812858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073812858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073812858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073812858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073812858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073812879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073812892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073812892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073812892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:16.640350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8299): Terminating (SIGTERM) 07:38:16.689615 run iperf3-srv_10.42.42.10(pid=8300): Terminating (SIGTERM) 07:38:16.741803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8303): Terminating (SIGTERM) 07:38:16.789977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8306): Terminating (SIGTERM) 07:38:16.841779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8309): Terminating (SIGTERM) 07:38:16.891402 --- ParallelTerminationStrategy: PID 8299 died... 07:38:16.914571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8299): Terminated: ok {rc=0} 07:38:16.970277 --- ParallelTerminationStrategy: PID 8300 died... 07:38:16.992384 run iperf3-srv_10.42.42.10(pid=8300): Terminated {rc=256} 07:38:17.046000 --- ParallelTerminationStrategy: PID 8303 died... 07:38:17.069552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8303): Terminated: ok {rc=0} 07:38:17.121019 --- ParallelTerminationStrategy: PID 8306 died... 07:38:17.144681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8306): Terminated: ok {rc=0} 07:38:17.194805 --- ParallelTerminationStrategy: PID 8309 died... 07:38:17.217576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8309): Terminated: ok {rc=0} 07:38:17.324587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:38:18.506021 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:18.519021 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:38:18.591704 tst iperf3m4.py: using LAC 19936 07:38:18.721758 tst iperf3m4.py: using RAC 46 07:38:18.852543 tst iperf3m4.py: using CellId 19936 07:38:18.982388 tst iperf3m4.py: using BVCI 19937 07:38:19.105931 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.119048 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.131638 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.143992 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.156190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.168631 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.181444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.193913 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:19.207282 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:19.332055 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:19.462645 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:19.586635 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:19.712895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:38:19.937442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:20.270104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8311): Launched 07:38:20.568187 run iperf3-srv_10.42.42.10(pid=8312): Launched 07:38:20.705972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:38:20.929152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:21.264539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8313): Launched 07:38:21.562717 run iperf3-srv_10.42.42.10(pid=8314): Launched 07:38:21.700512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:38:21.924735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:22.258178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8315): Launched 07:38:22.558583 run iperf3-srv_10.42.42.10(pid=8316): Launched 07:38:22.697301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:38:22.920847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:23.257106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8317): Launched 07:38:23.557505 run iperf3-srv_10.42.42.10(pid=8318): Launched 07:38:23.695140 tst iperf3m4.py:8: start network... 07:38:23.918348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:24.438304 run create_hlr_db(pid=8319): Launched 07:38:24.605947 bus /gobi_6: Setting Powered False 07:38:25.671406 run create_hlr_db(pid=8319): Terminated: ok {rc=0} 07:38:26.134100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8321): Launched 07:38:26.478680 run osmo-hlr_10.42.42.2(pid=8322): Launched 07:38:26.603249 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:27.159513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8324): Launched 07:38:27.484423 run osmo-stp_10.42.42.5(pid=8326): Launched 07:38:27.605245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:28.158480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8328): Launched 07:38:28.281560 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:28.553650 run patchelf(pid=8329): Launched 07:38:28.732652 run osmo-stp_10.42.42.5(pid=8326): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8326)] 07:38:28.868487 run osmo-stp_10.42.42.5(pid=8326): stdout: | (launched: 2022-12-09_07:38:27.424751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:29.005745 run osmo-stp_10.42.42.5(pid=8326): stderr: | 20221209073827613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073827613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073827614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073827614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073827614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073827615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073827615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:29.142869 run osmo-stp_10.42.42.5(pid=8326): stdout: | (launched: 2022-12-09_07:38:27.424751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:29.274218 run osmo-stp_10.42.42.5(pid=8326): stderr: | 20221209073827613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073827613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073827614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073827614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073827614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073827615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073827615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:29.430289 run patchelf(pid=8329): Terminating (SIGINT) 07:38:29.607959 run patchelf(pid=8329): Terminated: ok {rc=0} 07:38:29.735948 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8326): Process ended prematurely: osmo-stp_10.42.42.5(pid=8326) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8326)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:38:29.746277 tst iperf3m4.py:8: Test FAILED (11.3 sec) 07:38:29.774652 run osmo-hlr_10.42.42.2(pid=8322): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8322)] 07:38:29.824245 run osmo-hlr_10.42.42.2(pid=8322): stdout: | (launched: 2022-12-09_07:38:26.419498) 07:38:29.875830 run osmo-hlr_10.42.42.2(pid=8322): stderr: | 20221209073826614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073826614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073826614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073826614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073826614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073826615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073826627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073826637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073826637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073826637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:29.927826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8311): Terminating (SIGTERM) 07:38:29.969045 run iperf3-srv_10.42.42.10(pid=8312): Terminating (SIGTERM) 07:38:30.010207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8313): Terminating (SIGTERM) 07:38:30.051625 run iperf3-srv_10.42.42.10(pid=8314): Terminating (SIGTERM) 07:38:30.094470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8315): Terminating (SIGTERM) 07:38:30.136307 run iperf3-srv_10.42.42.10(pid=8316): Terminating (SIGTERM) 07:38:30.178006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8317): Terminating (SIGTERM) 07:38:30.219721 run iperf3-srv_10.42.42.10(pid=8318): Terminating (SIGTERM) 07:38:30.261100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8321): Terminating (SIGTERM) 07:38:30.302388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8324): Terminating (SIGTERM) 07:38:30.344004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8328): Terminating (SIGTERM) 07:38:30.385988 --- ParallelTerminationStrategy: PID 8311 died... 07:38:30.406058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8311): Terminated: ok {rc=0} 07:38:30.452347 --- ParallelTerminationStrategy: PID 8312 died... 07:38:30.471938 run iperf3-srv_10.42.42.10(pid=8312): Terminated {rc=256} 07:38:30.518318 --- ParallelTerminationStrategy: PID 8313 died... 07:38:30.537875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8313): Terminated: ok {rc=0} 07:38:30.583829 --- ParallelTerminationStrategy: PID 8314 died... 07:38:30.603160 run iperf3-srv_10.42.42.10(pid=8314): Terminated {rc=256} 07:38:30.648482 --- ParallelTerminationStrategy: PID 8315 died... 07:38:30.667826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8315): Terminated: ok {rc=0} 07:38:30.713233 --- ParallelTerminationStrategy: PID 8316 died... 07:38:30.732560 run iperf3-srv_10.42.42.10(pid=8316): Terminated {rc=256} 07:38:30.778102 --- ParallelTerminationStrategy: PID 8317 died... 07:38:30.797500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8317): Terminated: ok {rc=0} 07:38:30.857511 --- ParallelTerminationStrategy: PID 8318 died... 07:38:30.878236 run iperf3-srv_10.42.42.10(pid=8318): Terminated {rc=256} 07:38:30.925165 --- ParallelTerminationStrategy: PID 8321 died... 07:38:30.944907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8321): Terminated: ok {rc=0} 07:38:30.991465 --- ParallelTerminationStrategy: PID 8324 died... 07:38:31.011446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8324): Terminated: ok {rc=0} 07:38:31.058084 --- ParallelTerminationStrategy: PID 8328 died... 07:38:31.078406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8328): Terminated: ok {rc=0} 07:38:31.168061 bus /gobi_4: Setting Powered False 07:38:32.268048 bus /gobi_4: Setting Powered False 07:38:33.382811 bus /gobi_1: Setting Powered False 07:38:34.480329 bus /gobi_1: Setting Powered False 07:38:35.594360 bus /gobi_0: Setting Powered False 07:38:36.692079 bus /gobi_0: Setting Powered False 07:38:37.807611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:38:38.910030 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:38.922407 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:38:38.995461 tst ping.py: using LAC 19937 07:38:39.113168 tst ping.py: using RAC 47 07:38:39.227931 tst ping.py: using CellId 19937 07:38:39.344630 tst ping.py: using BVCI 19938 07:38:39.451001 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.462046 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.473129 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.483956 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.494699 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.505603 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.516444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:39.527301 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:39.646720 tst ping.py:19: start network... 07:38:39.841184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:40.297759 run create_hlr_db(pid=8330): Launched 07:38:40.408678 bus /gobi_6: Setting Powered False 07:38:41.467740 run create_hlr_db(pid=8330): Terminated: ok {rc=0} 07:38:41.879969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8332): Launched 07:38:42.173491 run osmo-hlr_10.42.42.2(pid=8333): Launched 07:38:42.285856 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:42.805127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8335): Launched 07:38:43.120565 run osmo-stp_10.42.42.5(pid=8336): Launched 07:38:43.239611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:43.785433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8338): Launched 07:38:43.906671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:44.173327 run patchelf(pid=8339): Launched 07:38:44.349806 run osmo-stp_10.42.42.5(pid=8336): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] 07:38:44.483568 run osmo-stp_10.42.42.5(pid=8336): stdout: | (launched: 2022-12-09_07:38:43.062304) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:44.618874 run osmo-stp_10.42.42.5(pid=8336): stderr: | 20221209073843251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073843251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073843251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073843252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073843252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073843252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073843252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:44.753639 run osmo-stp_10.42.42.5(pid=8336): stdout: | (launched: 2022-12-09_07:38:43.062304) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:44.883586 run osmo-stp_10.42.42.5(pid=8336): stderr: | 20221209073843251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073843251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073843251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073843252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073843252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073843252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073843252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:45.036728 run patchelf(pid=8339): Terminating (SIGINT) 07:38:45.212488 run patchelf(pid=8339): Terminated: ok {rc=0} 07:38:45.339145 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8336): Process ended prematurely: osmo-stp_10.42.42.5(pid=8336) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 07:38:45.348738 tst ping.py:22: Test FAILED (6.4 sec) 07:38:45.376831 run osmo-hlr_10.42.42.2(pid=8333): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8333)] 07:38:45.426953 run osmo-hlr_10.42.42.2(pid=8333): stdout: | (launched: 2022-12-09_07:38:42.118944) 07:38:45.478843 run osmo-hlr_10.42.42.2(pid=8333): stderr: | 20221209073842292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073842293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073842293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073842293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073842293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073842293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073842304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073842313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073842313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073842313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:45.531905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8332): Terminating (SIGTERM) 07:38:45.574132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8335): Terminating (SIGTERM) 07:38:45.616148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8338): Terminating (SIGTERM) 07:38:45.658564 --- ParallelTerminationStrategy: PID 8332 died... 07:38:45.678682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8332): Terminated: ok {rc=0} 07:38:45.725187 --- ParallelTerminationStrategy: PID 8335 died... 07:38:45.744896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8335): Terminated: ok {rc=0} 07:38:45.791062 --- ParallelTerminationStrategy: PID 8338 died... 07:38:45.810645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8338): Terminated: ok {rc=0} 07:38:45.930609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:38:47.026478 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.042514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:38:47.130705 tst ping_idle_ping.py: using LAC 19938 07:38:47.276192 tst ping_idle_ping.py: using RAC 48 07:38:47.401350 tst ping_idle_ping.py: using CellId 19938 07:38:47.524774 tst ping_idle_ping.py: using BVCI 19939 07:38:47.640698 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.652325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.663770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.675104 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.686292 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.697555 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.708877 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:38:47.720199 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:38:47.842119 tst ping_idle_ping.py:24: start network... 07:38:48.055266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:48.546397 run create_hlr_db(pid=8340): Launched 07:38:48.676511 bus /gobi_6: Setting Powered False 07:38:49.739718 run create_hlr_db(pid=8340): Terminated: ok {rc=0} 07:38:50.162505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8342): Launched 07:38:50.461014 run osmo-hlr_10.42.42.2(pid=8343): Launched 07:38:50.574275 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:51.094909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8345): Launched 07:38:51.390907 run osmo-stp_10.42.42.5(pid=8346): Launched 07:38:51.504474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:52.016042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8348): Launched 07:38:52.128228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:52.378858 run patchelf(pid=8349): Launched 07:38:52.544595 run osmo-stp_10.42.42.5(pid=8346): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8346)] 07:38:52.669791 run osmo-stp_10.42.42.5(pid=8346): stdout: | (launched: 2022-12-09_07:38:51.335985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:52.796471 run osmo-stp_10.42.42.5(pid=8346): stderr: | 20221209073851503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073851503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073851503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073851504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073851504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073851505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073851505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:52.923368 run osmo-stp_10.42.42.5(pid=8346): stdout: | (launched: 2022-12-09_07:38:51.335985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:53.044418 run osmo-stp_10.42.42.5(pid=8346): stderr: | 20221209073851503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073851503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073851503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073851504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073851504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073851505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073851505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:53.187834 run patchelf(pid=8349): Terminating (SIGINT) 07:38:53.353688 run patchelf(pid=8349): Terminated: ok {rc=0} 07:38:53.472785 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8346): Process ended prematurely: osmo-stp_10.42.42.5(pid=8346) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8346)] [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:38:53.482080 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:38:53.508607 run osmo-hlr_10.42.42.2(pid=8343): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8343)] 07:38:53.556050 run osmo-hlr_10.42.42.2(pid=8343): stdout: | (launched: 2022-12-09_07:38:50.406201) 07:38:53.606031 run osmo-hlr_10.42.42.2(pid=8343): stderr: | 20221209073850578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073850578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073850578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073850578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073850578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073850578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073850590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073850599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073850599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073850599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:53.655774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8342): Terminating (SIGTERM) 07:38:53.695150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8345): Terminating (SIGTERM) 07:38:53.734665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8348): Terminating (SIGTERM) 07:38:53.774277 --- ParallelTerminationStrategy: PID 8342 died... 07:38:53.792561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8342): Terminated: ok {rc=0} 07:38:53.836163 --- ParallelTerminationStrategy: PID 8345 died... 07:38:53.854861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8345): Terminated: ok {rc=0} 07:38:53.898542 --- ParallelTerminationStrategy: PID 8348 died... 07:38:53.916898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8348): Terminated: ok {rc=0} 07:38:54.002903 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:38:55.308821 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:38:55.315594 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:38:55.348371 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 07:38:55.387787 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 07:38:55.475502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:38:55.508107 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 07:38:55.546750 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 07:38:56.154224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 07:38:56.202350 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.213800 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:38:56.266313 tst cs_paging_gprs_active.py: using LAC 19939 07:38:56.385238 tst cs_paging_gprs_active.py: using RAC 49 07:38:56.511411 tst cs_paging_gprs_active.py: using CellId 19939 07:38:56.629128 tst cs_paging_gprs_active.py: using BVCI 19940 07:38:56.739125 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.750823 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.762035 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.773306 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.784348 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.795349 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.806519 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.817658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:56.828997 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:38:56.950930 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:38:57.069129 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:38:57.269370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:57.570932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8354): Launched 07:38:57.832445 run iperf3-srv_10.42.42.10(pid=8355): Launched 07:38:57.944938 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:38:58.145676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:58.447026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8356): Launched 07:38:58.710036 run iperf3-srv_10.42.42.10(pid=8357): Launched 07:38:58.822361 tst cs_paging_gprs_active.py:38: start network... 07:38:59.022891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:59.487953 run create_hlr_db(pid=8358): Launched 07:38:59.601248 bus /gobi_6: Setting Powered False 07:39:00.661267 run create_hlr_db(pid=8358): Terminated: ok {rc=0} 07:39:01.106425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8360): Launched 07:39:01.427757 run osmo-hlr_10.42.42.2(pid=8361): Launched 07:39:01.745329 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:02.337784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8363): Launched 07:39:02.658098 run osmo-stp_10.42.42.5(pid=8364): Launched 07:39:02.781102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:03.335545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8366): Launched 07:39:03.458608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:03.729183 run patchelf(pid=8367): Launched 07:39:03.907266 run osmo-stp_10.42.42.5(pid=8364): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8364)] 07:39:04.041934 run osmo-stp_10.42.42.5(pid=8364): stdout: | (launched: 2022-12-09_07:39:02.598541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:04.178086 run osmo-stp_10.42.42.5(pid=8364): stderr: | 20221209073902788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073902788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073902788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073902789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073902789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073902789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073902789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:04.314618 run osmo-stp_10.42.42.5(pid=8364): stdout: | (launched: 2022-12-09_07:39:02.598541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:04.445446 run osmo-stp_10.42.42.5(pid=8364): stderr: | 20221209073902788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073902788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073902788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073902789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073902789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073902789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073902789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:04.600783 run patchelf(pid=8367): Terminating (SIGINT) 07:39:04.778511 run patchelf(pid=8367): Terminated: ok {rc=0} 07:39:04.907472 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8364): Process ended prematurely: osmo-stp_10.42.42.5(pid=8364) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8364)] [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 07:39:04.917747 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:39:04.946092 run osmo-hlr_10.42.42.2(pid=8361): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8361)] 07:39:04.995881 run osmo-hlr_10.42.42.2(pid=8361): stdout: | (launched: 2022-12-09_07:39:01.366980) 07:39:05.047685 run osmo-hlr_10.42.42.2(pid=8361): stderr: | 20221209073901558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073901558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073901558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073901558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073901558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073901558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073901573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073901597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073901598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073901599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:05.099697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8354): Terminating (SIGTERM) 07:39:05.141180 run iperf3-srv_10.42.42.10(pid=8355): Terminating (SIGTERM) 07:39:05.182523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8356): Terminating (SIGTERM) 07:39:05.223906 run iperf3-srv_10.42.42.10(pid=8357): Terminating (SIGTERM) 07:39:05.265098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8360): Terminating (SIGTERM) 07:39:05.306348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8363): Terminating (SIGTERM) 07:39:05.347789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8366): Terminating (SIGTERM) 07:39:05.389321 --- ParallelTerminationStrategy: PID 8354 died... 07:39:05.409034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8354): Terminated: ok {rc=0} 07:39:05.454541 --- ParallelTerminationStrategy: PID 8355 died... 07:39:05.473683 run iperf3-srv_10.42.42.10(pid=8355): Terminated {rc=256} 07:39:05.518790 --- ParallelTerminationStrategy: PID 8356 died... 07:39:05.537971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8356): Terminated: ok {rc=0} 07:39:05.583221 --- ParallelTerminationStrategy: PID 8357 died... 07:39:05.602344 run iperf3-srv_10.42.42.10(pid=8357): Terminated {rc=256} 07:39:05.647633 --- ParallelTerminationStrategy: PID 8360 died... 07:39:05.666962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8360): Terminated: ok {rc=0} 07:39:05.713239 --- ParallelTerminationStrategy: PID 8363 died... 07:39:05.732602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8363): Terminated: ok {rc=0} 07:39:05.778769 --- ParallelTerminationStrategy: PID 8366 died... 07:39:05.798255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8366): Terminated: ok {rc=0} 07:39:05.886139 bus /gobi_0: Setting Powered False 07:39:06.986981 bus /gobi_0: Setting Powered False 07:39:08.101468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 07:39:09.248809 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.261365 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:39:09.324877 tst iperf3.py: using LAC 19940 07:39:09.449904 tst iperf3.py: using RAC 50 07:39:09.577474 tst iperf3.py: using CellId 19940 07:39:09.701445 tst iperf3.py: using BVCI 19941 07:39:09.818195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.830041 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.841717 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.853469 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.865099 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.876598 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.888714 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.900458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:09.912405 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:10.028188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:39:10.229297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:10.530230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8368): Launched 07:39:10.792427 run iperf3-srv_10.42.42.10(pid=8369): Launched 07:39:10.904312 tst iperf3.py:8: start network... 07:39:11.104782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:11.567910 run create_hlr_db(pid=8370): Launched 07:39:11.681409 bus /gobi_6: Setting Powered False 07:39:12.740216 run create_hlr_db(pid=8370): Terminated: ok {rc=0} 07:39:13.175202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8372): Launched 07:39:13.494178 run osmo-hlr_10.42.42.2(pid=8373): Launched 07:39:13.614613 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:14.162828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8375): Launched 07:39:14.479872 run osmo-stp_10.42.42.5(pid=8376): Launched 07:39:14.600343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:15.150013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8378): Launched 07:39:15.270715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:15.539612 run patchelf(pid=8379): Launched 07:39:15.715440 run osmo-stp_10.42.42.5(pid=8376): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8376)] 07:39:15.850914 run osmo-stp_10.42.42.5(pid=8376): stdout: | (launched: 2022-12-09_07:39:14.421476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:15.995431 run osmo-stp_10.42.42.5(pid=8376): stderr: | 20221209073914610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073914610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073914610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073914611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073914611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073914611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073914611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:16.134106 run osmo-stp_10.42.42.5(pid=8376): stdout: | (launched: 2022-12-09_07:39:14.421476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:16.266614 run osmo-stp_10.42.42.5(pid=8376): stderr: | 20221209073914610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073914610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073914610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073914611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073914611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073914611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073914611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:16.423732 run patchelf(pid=8379): Terminating (SIGINT) 07:39:16.604373 run patchelf(pid=8379): Terminated: ok {rc=0} 07:39:16.734439 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8376): Process ended prematurely: osmo-stp_10.42.42.5(pid=8376) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8376)] [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 07:39:16.745417 tst iperf3.py:8: Test FAILED (7.5 sec) 07:39:16.774484 run osmo-hlr_10.42.42.2(pid=8373): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8373)] 07:39:16.825945 run osmo-hlr_10.42.42.2(pid=8373): stdout: | (launched: 2022-12-09_07:39:13.435693) 07:39:16.878407 run osmo-hlr_10.42.42.2(pid=8373): stderr: | 20221209073913630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073913631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073913631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073913631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073913631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073913631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073913643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073913651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073913652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073913652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:16.931456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8368): Terminating (SIGTERM) 07:39:16.974532 run iperf3-srv_10.42.42.10(pid=8369): Terminating (SIGTERM) 07:39:17.019707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8372): Terminating (SIGTERM) 07:39:17.063015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8375): Terminating (SIGTERM) 07:39:17.106778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8378): Terminating (SIGTERM) 07:39:17.149154 --- ParallelTerminationStrategy: PID 8368 died... 07:39:17.169099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8368): Terminated: ok {rc=0} 07:39:17.215241 --- ParallelTerminationStrategy: PID 8369 died... 07:39:17.234448 run iperf3-srv_10.42.42.10(pid=8369): Terminated {rc=256} 07:39:17.279915 --- ParallelTerminationStrategy: PID 8372 died... 07:39:17.299248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8372): Terminated: ok {rc=0} 07:39:17.344823 --- ParallelTerminationStrategy: PID 8375 died... 07:39:17.364549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8375): Terminated: ok {rc=0} 07:39:17.410409 --- ParallelTerminationStrategy: PID 8378 died... 07:39:17.429966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8378): Terminated: ok {rc=0} 07:39:17.517163 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 07:39:18.665718 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:18.678192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:39:18.729981 tst iperf3m4.py: using LAC 19941 07:39:18.852389 tst iperf3m4.py: using RAC 51 07:39:18.975272 tst iperf3m4.py: using CellId 19941 07:39:19.099017 tst iperf3m4.py: using BVCI 19942 07:39:19.214154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.226064 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.237764 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.249468 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.261126 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.272713 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.284500 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.296126 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:19.307989 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:19.425062 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:19.545833 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:19.667648 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:19.784458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:39:19.984700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:20.284215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Launched 07:39:20.543160 run iperf3-srv_10.42.42.10(pid=8381): Launched 07:39:20.654097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:39:20.852683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:21.151170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8382): Launched 07:39:21.410867 run iperf3-srv_10.42.42.10(pid=8383): Launched 07:39:21.521899 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:39:21.720330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:22.019401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8384): Launched 07:39:22.277947 run iperf3-srv_10.42.42.10(pid=8385): Launched 07:39:22.388932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:39:22.587070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:22.886127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8386): Launched 07:39:23.144031 run iperf3-srv_10.42.42.10(pid=8387): Launched 07:39:23.254916 tst iperf3m4.py:8: start network... 07:39:23.453714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:23.914684 run create_hlr_db(pid=8388): Launched 07:39:24.029743 bus /gobi_6: Setting Powered False 07:39:25.089141 run create_hlr_db(pid=8388): Terminated: ok {rc=0} 07:39:25.505492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8390): Launched 07:39:25.802817 run osmo-hlr_10.42.42.2(pid=8391): Launched 07:39:25.916724 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:26.433580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8393): Launched 07:39:26.730369 run osmo-stp_10.42.42.5(pid=8394): Launched 07:39:26.842779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:27.355488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8396): Launched 07:39:27.468438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:27.720772 run patchelf(pid=8397): Launched 07:39:27.887203 run osmo-stp_10.42.42.5(pid=8394): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8394)] 07:39:28.014174 run osmo-stp_10.42.42.5(pid=8394): stdout: | (launched: 2022-12-09_07:39:26.675269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:28.142127 run osmo-stp_10.42.42.5(pid=8394): stderr: | 20221209073926841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073926842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073926842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073926842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073926843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073926843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073926843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:28.270240 run osmo-stp_10.42.42.5(pid=8394): stdout: | (launched: 2022-12-09_07:39:26.675269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:28.393258 run osmo-stp_10.42.42.5(pid=8394): stderr: | 20221209073926841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073926842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073926842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073926842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073926843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073926843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073926843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:28.538818 run patchelf(pid=8397): Terminating (SIGINT) 07:39:28.706428 run patchelf(pid=8397): Terminated: ok {rc=0} 07:39:28.827261 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8394): Process ended prematurely: osmo-stp_10.42.42.5(pid=8394) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8394)] [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 07:39:28.836818 tst iperf3m4.py:8: Test FAILED (10.2 sec) 07:39:28.865266 run osmo-hlr_10.42.42.2(pid=8391): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8391)] 07:39:28.913115 run osmo-hlr_10.42.42.2(pid=8391): stdout: | (launched: 2022-12-09_07:39:25.747734) 07:39:28.962122 run osmo-hlr_10.42.42.2(pid=8391): stderr: | 20221209073925920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073925920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073925920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073925921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073925921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073925921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073925933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073925942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073925942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073925942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:29.011722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Terminating (SIGTERM) 07:39:29.050856 run iperf3-srv_10.42.42.10(pid=8381): Terminating (SIGTERM) 07:39:29.090048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8382): Terminating (SIGTERM) 07:39:29.129435 run iperf3-srv_10.42.42.10(pid=8383): Terminating (SIGTERM) 07:39:29.168506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8384): Terminating (SIGTERM) 07:39:29.207791 run iperf3-srv_10.42.42.10(pid=8385): Terminating (SIGTERM) 07:39:29.246795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8386): Terminating (SIGTERM) 07:39:29.285899 run iperf3-srv_10.42.42.10(pid=8387): Terminating (SIGTERM) 07:39:29.324915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8390): Terminating (SIGTERM) 07:39:29.364139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8393): Terminating (SIGTERM) 07:39:29.403479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8396): Terminating (SIGTERM) 07:39:29.442887 --- ParallelTerminationStrategy: PID 8380 died... 07:39:29.461679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Terminated: ok {rc=0} 07:39:29.505347 --- ParallelTerminationStrategy: PID 8381 died... 07:39:29.523604 run iperf3-srv_10.42.42.10(pid=8381): Terminated {rc=256} 07:39:29.571979 --- ParallelTerminationStrategy: PID 8382 died... 07:39:29.592197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8382): Terminated: ok {rc=0} 07:39:29.637991 --- ParallelTerminationStrategy: PID 8383 died... 07:39:29.657144 run iperf3-srv_10.42.42.10(pid=8383): Terminated {rc=256} 07:39:29.702982 --- ParallelTerminationStrategy: PID 8384 died... 07:39:29.722331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8384): Terminated: ok {rc=0} 07:39:29.768479 --- ParallelTerminationStrategy: PID 8385 died... 07:39:29.787736 run iperf3-srv_10.42.42.10(pid=8385): Terminated {rc=256} 07:39:29.832835 --- ParallelTerminationStrategy: PID 8386 died... 07:39:29.852392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8386): Terminated: ok {rc=0} 07:39:29.899029 --- ParallelTerminationStrategy: PID 8387 died... 07:39:29.918281 run iperf3-srv_10.42.42.10(pid=8387): Terminated {rc=256} 07:39:29.963618 --- ParallelTerminationStrategy: PID 8390 died... 07:39:29.983033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8390): Terminated: ok {rc=0} 07:39:30.028776 --- ParallelTerminationStrategy: PID 8393 died... 07:39:30.048492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8393): Terminated: ok {rc=0} 07:39:30.094089 --- ParallelTerminationStrategy: PID 8396 died... 07:39:30.113458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8396): Terminated: ok {rc=0} 07:39:30.199910 bus /gobi_4: Setting Powered False 07:39:31.295600 bus /gobi_4: Setting Powered False 07:39:32.407349 bus /gobi_1: Setting Powered False 07:39:33.504677 bus /gobi_1: Setting Powered False 07:39:34.618668 bus /gobi_0: Setting Powered False 07:39:35.714057 bus /gobi_0: Setting Powered False 07:39:36.827792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 07:39:37.931209 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:37.943748 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:39:37.997804 tst ping.py: using LAC 19942 07:39:38.122031 tst ping.py: using RAC 52 07:39:38.236145 tst ping.py: using CellId 19942 07:39:38.350223 tst ping.py: using BVCI 19943 07:39:38.457639 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.468867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.480000 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.491365 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.502573 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.513894 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.525305 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:38.536635 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:38.653209 tst ping.py:19: start network... 07:39:38.862522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:39.346826 run create_hlr_db(pid=8399): Launched 07:39:39.473514 bus /gobi_6: Setting Powered False 07:39:40.534980 run create_hlr_db(pid=8399): Terminated: ok {rc=0} 07:39:40.950457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8401): Launched 07:39:41.240839 run osmo-hlr_10.42.42.2(pid=8402): Launched 07:39:41.351291 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:41.859144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8404): Launched 07:39:42.150419 run osmo-stp_10.42.42.5(pid=8405): Launched 07:39:42.260471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:42.763371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8407): Launched 07:39:42.874761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:43.122105 run patchelf(pid=8408): Launched 07:39:43.291543 run osmo-stp_10.42.42.5(pid=8405): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8405)] 07:39:43.414438 run osmo-stp_10.42.42.5(pid=8405): stdout: | (launched: 2022-12-09_07:39:42.096293) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:43.539281 run osmo-stp_10.42.42.5(pid=8405): stderr: | 20221209073942261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073942261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073942262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073942262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073942262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073942263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073942263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:43.663860 run osmo-stp_10.42.42.5(pid=8405): stdout: | (launched: 2022-12-09_07:39:42.096293) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:43.783305 run osmo-stp_10.42.42.5(pid=8405): stderr: | 20221209073942261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073942261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073942262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073942262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073942262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073942263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073942263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:43.924504 run patchelf(pid=8408): Terminating (SIGINT) 07:39:44.086751 run patchelf(pid=8408): Terminated: ok {rc=0} 07:39:44.203477 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8405): Process ended prematurely: osmo-stp_10.42.42.5(pid=8405) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8405)] [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 07:39:44.212478 tst ping.py:22: Test FAILED (6.3 sec) 07:39:44.239069 run osmo-hlr_10.42.42.2(pid=8402): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8402)] 07:39:44.286353 run osmo-hlr_10.42.42.2(pid=8402): stdout: | (launched: 2022-12-09_07:39:41.186922) 07:39:44.335231 run osmo-hlr_10.42.42.2(pid=8402): stderr: | 20221209073941355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073941355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073941355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073941355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073941355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073941355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073941368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073941378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073941378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073941378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:44.384560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8401): Terminating (SIGTERM) 07:39:44.423764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8404): Terminating (SIGTERM) 07:39:44.463110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8407): Terminating (SIGTERM) 07:39:44.502281 --- ParallelTerminationStrategy: PID 8401 died... 07:39:44.521367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8401): Terminated: ok {rc=0} 07:39:44.565021 --- ParallelTerminationStrategy: PID 8404 died... 07:39:44.583402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8404): Terminated: ok {rc=0} 07:39:44.626709 --- ParallelTerminationStrategy: PID 8407 died... 07:39:44.644921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8407): Terminated: ok {rc=0} 07:39:44.730525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 07:39:45.815498 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:45.827520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:39:45.906374 tst ping_idle_ping.py: using LAC 19943 07:39:46.033970 tst ping_idle_ping.py: using RAC 53 07:39:46.162733 tst ping_idle_ping.py: using CellId 19943 07:39:46.288492 tst ping_idle_ping.py: using BVCI 19944 07:39:46.427158 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.439353 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.451384 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.464058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.477557 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.489559 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.501908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:39:46.514808 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:39:46.633689 tst ping_idle_ping.py:24: start network... 07:39:46.860630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:47.366333 run create_hlr_db(pid=8409): Launched 07:39:47.508127 bus /gobi_6: Setting Powered False 07:39:48.569977 run create_hlr_db(pid=8409): Terminated: ok {rc=0} 07:39:49.008739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8411): Launched 07:39:49.323601 run osmo-hlr_10.42.42.2(pid=8412): Launched 07:39:49.443113 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:49.984084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8414): Launched 07:39:50.298153 run osmo-stp_10.42.42.5(pid=8415): Launched 07:39:50.419250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:50.961417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8417): Launched 07:39:51.080271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:51.344342 run patchelf(pid=8418): Launched 07:39:51.518075 run osmo-stp_10.42.42.5(pid=8415): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8415)] 07:39:51.650643 run osmo-stp_10.42.42.5(pid=8415): stdout: | (launched: 2022-12-09_07:39:50.240780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:51.785021 run osmo-stp_10.42.42.5(pid=8415): stderr: | 20221209073950427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073950427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073950428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073950428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073950428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073950429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073950429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:51.920072 run osmo-stp_10.42.42.5(pid=8415): stdout: | (launched: 2022-12-09_07:39:50.240780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:52.049197 run osmo-stp_10.42.42.5(pid=8415): stderr: | 20221209073950427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073950427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073950428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073950428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073950428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073950429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073950429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:52.202102 run patchelf(pid=8418): Terminating (SIGINT) 07:39:52.377586 run patchelf(pid=8418): Terminated: ok {rc=0} 07:39:52.504137 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8415): Process ended prematurely: osmo-stp_10.42.42.5(pid=8415) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8415)] [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 07:39:52.513989 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:39:52.541765 run osmo-hlr_10.42.42.2(pid=8412): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8412)] 07:39:52.591417 run osmo-hlr_10.42.42.2(pid=8412): stdout: | (launched: 2022-12-09_07:39:49.265727) 07:39:52.642553 run osmo-hlr_10.42.42.2(pid=8412): stderr: | 20221209073949459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073949459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073949459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073949459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073949459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073949459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073949471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073949479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073949480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073949480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:52.694194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8411): Terminating (SIGTERM) 07:39:52.735481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8414): Terminating (SIGTERM) 07:39:52.777109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8417): Terminating (SIGTERM) 07:39:52.818851 --- ParallelTerminationStrategy: PID 8411 died... 07:39:52.838521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8411): Terminated: ok {rc=0} 07:39:52.884264 --- ParallelTerminationStrategy: PID 8414 died... 07:39:52.903644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8414): Terminated: ok {rc=0} 07:39:52.949376 --- ParallelTerminationStrategy: PID 8417 died... 07:39:52.968762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8417): Terminated: ok {rc=0} 07:39:53.055812 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:39:54.371854 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:54.379665 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:39:54.413807 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:39:54.449680 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:39:54.504266 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:39:54.538034 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:39:54.573890 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:39:55.141652 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:39:55.146831 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.158643 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:39:55.229842 tst switch_tch_pdch.py: using LAC 19944 07:39:55.353509 tst switch_tch_pdch.py: using RAC 54 07:39:55.471243 tst switch_tch_pdch.py: using CellId 19944 07:39:55.589042 tst switch_tch_pdch.py: using BVCI 19945 07:39:55.695087 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.706590 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.717988 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.729605 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.740900 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.752156 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.763682 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:39:55.774997 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:39:55.894466 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:39:56.010371 tst switch_tch_pdch.py:51: start network... 07:39:56.207270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:56.661806 run create_hlr_db(pid=8424): Launched 07:39:56.772068 bus /gobi_6: Setting Powered False 07:39:57.831026 run create_hlr_db(pid=8424): Terminated: ok {rc=0} 07:39:58.241063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8426): Launched 07:39:58.533692 run osmo-hlr_10.42.42.2(pid=8427): Launched 07:39:58.645943 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:59.161819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8429): Launched 07:39:59.454158 run osmo-stp_10.42.42.5(pid=8430): Launched 07:39:59.565691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:00.070435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8432): Launched 07:40:00.182332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:00.430861 run patchelf(pid=8433): Launched 07:40:00.593646 run osmo-stp_10.42.42.5(pid=8430): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8430)] 07:40:00.717851 run osmo-stp_10.42.42.5(pid=8430): stdout: | (launched: 2022-12-09_07:39:59.400320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:00.861934 run osmo-stp_10.42.42.5(pid=8430): stderr: | 20221209073959566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073959566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073959566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073959567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073959567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073959567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073959567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:01.001676 run osmo-stp_10.42.42.5(pid=8430): stdout: | (launched: 2022-12-09_07:39:59.400320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:01.125347 run osmo-stp_10.42.42.5(pid=8430): stderr: | 20221209073959566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209073959566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209073959566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209073959567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209073959567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209073959567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209073959567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:01.271871 run patchelf(pid=8433): Terminating (SIGINT) 07:40:01.451434 run patchelf(pid=8433): Terminated: ok {rc=0} 07:40:01.573382 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8430): Process ended prematurely: osmo-stp_10.42.42.5(pid=8430) [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8430)] [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:40:01.583530 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 07:40:01.613580 run osmo-hlr_10.42.42.2(pid=8427): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8427)] 07:40:01.663773 run osmo-hlr_10.42.42.2(pid=8427): stdout: | (launched: 2022-12-09_07:39:58.480231) 07:40:01.715297 run osmo-hlr_10.42.42.2(pid=8427): stderr: | 20221209073958650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209073958651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209073958651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209073958651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209073958651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209073958651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209073958664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209073958674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209073958674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209073958674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:01.767435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8426): Terminating (SIGTERM) 07:40:01.814632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8429): Terminating (SIGTERM) 07:40:01.865581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8432): Terminating (SIGTERM) 07:40:01.922553 --- ParallelTerminationStrategy: PID 8426 died... 07:40:01.949452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8426): Terminated: ok {rc=0} 07:40:02.011333 --- ParallelTerminationStrategy: PID 8429 died... 07:40:02.033298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8429): Terminated: ok {rc=0} 07:40:02.087577 --- ParallelTerminationStrategy: PID 8432 died... 07:40:02.107222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8432): Terminated: ok {rc=0} 07:40:02.195677 bus /gobi_0: Setting Powered False 07:40:03.300290 bus /gobi_0: Setting Powered False 07:40:04.415593 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:40:05.664127 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:05.669825 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:40:05.703000 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:40:05.737871 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:40:05.790516 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:40:05.823317 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:40:05.858112 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:40:06.413940 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:40:06.418858 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:06.429925 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:40:06.498838 tst switch_tch_pdch.py: using LAC 19945 07:40:06.612720 tst switch_tch_pdch.py: using RAC 55 07:40:06.726667 tst switch_tch_pdch.py: using CellId 19945 07:40:06.842817 tst switch_tch_pdch.py: using BVCI 19946 07:40:06.950637 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:06.961726 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:06.972472 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:06.983556 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:06.994672 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:07.005808 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:07.016923 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:40:07.027961 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:40:07.145569 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:40:07.261878 tst switch_tch_pdch.py:51: start network... 07:40:07.456110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:07.883635 run create_hlr_db(pid=8440): Launched 07:40:07.995257 bus /gobi_6: Setting Powered False 07:40:09.053780 run create_hlr_db(pid=8440): Terminated: ok {rc=0} 07:40:09.455137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8442): Launched 07:40:09.767964 run osmo-hlr_10.42.42.2(pid=8443): Launched 07:40:09.887079 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:10.399199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8445): Launched 07:40:10.712641 run osmo-stp_10.42.42.5(pid=8446): Launched 07:40:10.831487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:11.344049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8448): Launched 07:40:11.463133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:11.726437 run patchelf(pid=8449): Launched 07:40:11.899768 run osmo-stp_10.42.42.5(pid=8446): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8446)] 07:40:12.032117 run osmo-stp_10.42.42.5(pid=8446): stdout: | (launched: 2022-12-09_07:40:10.655615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:12.165609 run osmo-stp_10.42.42.5(pid=8446): stderr: | 20221209074010842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074010843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074010843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074010843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074010844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074010844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074010844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:12.299716 run osmo-stp_10.42.42.5(pid=8446): stdout: | (launched: 2022-12-09_07:40:10.655615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:12.427815 run osmo-stp_10.42.42.5(pid=8446): stderr: | 20221209074010842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074010843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074010843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074010843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074010844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074010844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074010844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:12.579420 run patchelf(pid=8449): Terminating (SIGINT) 07:40:12.753790 run patchelf(pid=8449): Terminated: ok {rc=0} 07:40:12.879831 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8446): Process ended prematurely: osmo-stp_10.42.42.5(pid=8446) [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8446)] [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:40:12.889733 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:40:12.917221 run osmo-hlr_10.42.42.2(pid=8443): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8443)] 07:40:12.966944 run osmo-hlr_10.42.42.2(pid=8443): stdout: | (launched: 2022-12-09_07:40:09.711034) 07:40:13.018208 run osmo-hlr_10.42.42.2(pid=8443): stderr: | 20221209074009903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074009903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074009903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074009903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074009903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074009903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074009915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074009923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074009923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074009923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:13.069808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8442): Terminating (SIGTERM) 07:40:13.111143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8445): Terminating (SIGTERM) 07:40:13.152573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8448): Terminating (SIGTERM) 07:40:13.194152 --- ParallelTerminationStrategy: PID 8442 died... 07:40:13.213483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8442): Terminated: ok {rc=0} 07:40:13.259122 --- ParallelTerminationStrategy: PID 8445 died... 07:40:13.278576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8445): Terminated: ok {rc=0} 07:40:13.324341 --- ParallelTerminationStrategy: PID 8448 died... 07:40:13.343793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8448): Terminated: ok {rc=0} 07:40:13.429973 bus /gobi_0: Setting Powered False 07:40:14.527148 bus /gobi_0: Setting Powered False 07:40:15.643315 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:trx-lms --------------------------------------------------------------------- 07:40:16.897606 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:16.902361 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 07:40:16.946571 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 07:40:16.956168 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 07:40:17.021314 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 07:40:17.062374 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 07:40:17.070006 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 07:40:17.602169 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 07:40:17.607202 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 07:40:17.618836 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 07:40:17.667556 tst mo_mt_sms.py: using LAC 19946 07:40:17.794343 tst mo_mt_sms.py: using RAC 56 07:40:17.919593 tst mo_mt_sms.py: using CellId 19946 07:40:18.042888 tst mo_mt_sms.py: using BVCI 19947 07:40:18.157731 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 07:40:18.273311 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 07:40:18.388928 tst mo_mt_sms.py:9: start nitb and bts... 07:40:18.600394 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:40:19.239872 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8453): Launched 07:40:19.552046 run osmo-nitb_10.42.42.2(pid=8454): Launched 07:40:19.725487 run osmo-nitb_10.42.42.2(pid=8454): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8454)] 07:40:19.865926 run osmo-nitb_10.42.42.2(pid=8454): stdout: | (launched: 2022-12-09_07:40:19.494823) 07:40:20.008678 run osmo-nitb_10.42.42.2(pid=8454): stderr: | (launched: 2022-12-09_07:40:19.541709) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:40:20.150800 run osmo-nitb_10.42.42.2(pid=8454): stdout: | (launched: 2022-12-09_07:40:19.494823) 07:40:20.288008 run osmo-nitb_10.42.42.2(pid=8454): stderr: | (launched: 2022-12-09_07:40:19.541709) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8454) [trial-2356↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8454)] 07:40:20.670376 tst osmo-nitb_10.42.42.2(pid=8454): stdout: | (launched: 2022-12-09_07:40:19.494823) 07:40:20.796323 tst osmo-nitb_10.42.42.2(pid=8454): stderr: | (launched: 2022-12-09_07:40:19.541709) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:40:20.945257 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8454) [trial-2356↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8454)] [trial-2356↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 07:40:20.954497 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:40:20.961584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8453): Terminating (SIGTERM) 07:40:21.171621 --- ParallelTerminationStrategy: PID 8453 died... 07:40:21.192873 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8453): Terminated: ok {rc=0} 07:40:21.280528 bus /sierra_3: Setting Powered False 07:40:22.379728 bus /sierra_3: Setting Powered False 07:40:23.497872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:trx-lms --------------------------------------------------------------------- 07:40:24.695118 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:24.699152 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 07:40:24.732823 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:40:24.759699 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 07:40:24.811363 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 07:40:24.844673 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:40:24.871161 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 07:40:25.418808 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 07:40:25.423742 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:25.434421 tst sms:trx-lms: Using 1 x bts (candidates: 1) 07:40:25.482465 tst mo_mt_sms.py: using LAC 19947 07:40:25.598884 tst mo_mt_sms.py: using RAC 57 07:40:25.716212 tst mo_mt_sms.py: using CellId 19947 07:40:25.831570 tst mo_mt_sms.py: using BVCI 19948 07:40:25.939297 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:25.949959 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:25.960386 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:25.971094 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:25.981963 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:25.992568 tst sms:trx-lms: Using 1 x modem (candidates: 2) 07:40:26.112056 tst sms:trx-lms: Using 1 x modem (candidates: 2) 07:40:26.230589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:26.684935 run create_hlr_db(pid=8458): Launched 07:40:26.797312 bus /sierra_2: Setting Powered False 07:40:27.855751 run create_hlr_db(pid=8458): Terminated: ok {rc=0} 07:40:28.263761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8460): Launched 07:40:28.555727 run osmo-hlr_10.42.42.2(pid=8461): Launched 07:40:28.667536 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:29.169725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8463): Launched 07:40:29.461092 run osmo-stp_10.42.42.5(pid=8464): Launched 07:40:29.573013 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:30.104724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8466): Launched 07:40:30.398044 run osmo-msc_10.42.42.6(pid=8467): Launched 07:40:30.560596 run osmo-stp_10.42.42.5(pid=8464): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8464)] 07:40:30.685193 run osmo-stp_10.42.42.5(pid=8464): stdout: | (launched: 2022-12-09_07:40:29.407101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:30.810144 run osmo-stp_10.42.42.5(pid=8464): stderr: | 20221209074029572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074029572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074029572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074029573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074029573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074029574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074029574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:30.963002 run osmo-stp_10.42.42.5(pid=8464): stdout: | (launched: 2022-12-09_07:40:29.407101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:31.094578 run osmo-stp_10.42.42.5(pid=8464): stderr: | 20221209074029572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074029572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074029572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074029573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074029573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074029574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074029574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:31.247535 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8464): Process ended prematurely: osmo-stp_10.42.42.5(pid=8464) [trial-2356↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8464)] [trial-2356↪sms:trx-lms↪mo_mt_sms.py:16] 07:40:31.257653 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 07:40:31.286825 run osmo-hlr_10.42.42.2(pid=8461): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8461)] 07:40:31.338026 run osmo-hlr_10.42.42.2(pid=8461): stdout: | (launched: 2022-12-09_07:40:28.502083) 07:40:31.390795 run osmo-hlr_10.42.42.2(pid=8461): stderr: | 20221209074028674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074028674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074028675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074028675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074028675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074028675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074028687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074028697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074028697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074028697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:31.464762 run osmo-msc_10.42.42.6(pid=8467): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8467)] 07:40:31.516231 run osmo-msc_10.42.42.6(pid=8467): stdout: | (launched: 2022-12-09_07:40:30.343945) 07:40:31.569254 run osmo-msc_10.42.42.6(pid=8467): stderr: | 20221209074030614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074030615 DLGLOBAL DEBUG validating counter group 0x7fbb3e7c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074030615 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074030615 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074030615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074030615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074030617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074030617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074030618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074030618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:31.623054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8460): Terminating (SIGTERM) 07:40:31.667231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8463): Terminating (SIGTERM) 07:40:31.711499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8466): Terminating (SIGTERM) 07:40:31.756415 --- ParallelTerminationStrategy: PID 8460 died... 07:40:31.777245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8460): Terminated: ok {rc=0} 07:40:31.826821 --- ParallelTerminationStrategy: PID 8463 died... 07:40:31.847112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8463): Terminated: ok {rc=0} 07:40:31.893885 --- ParallelTerminationStrategy: PID 8466 died... 07:40:31.914174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8466): Terminated: ok {rc=0} 07:40:32.003591 bus /sierra_3: Setting Powered False 07:40:33.103218 bus /sierra_3: Setting Powered False 07:40:34.218981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-lms --------------------------------------------------------------------- 07:40:35.449911 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:35.454036 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 07:40:35.488560 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 07:40:35.496114 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 07:40:35.532591 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 07:40:35.567420 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 07:40:35.574612 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 07:40:36.094815 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 07:40:36.100207 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 07:40:36.111793 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 07:40:36.161396 tst assert_extension.py: using LAC 19948 07:40:36.286717 tst assert_extension.py: using RAC 58 07:40:36.410554 tst assert_extension.py: using CellId 19948 07:40:36.530399 tst assert_extension.py: using BVCI 19949 07:40:36.636574 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 07:40:36.749765 tst assert_extension.py:10: start nitb and bts... 07:40:36.946394 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:40:37.546745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8472): Launched 07:40:37.839218 run osmo-nitb_10.42.42.2(pid=8473): Launched 07:40:38.001555 run osmo-nitb_10.42.42.2(pid=8473): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8473)] 07:40:38.133974 run osmo-nitb_10.42.42.2(pid=8473): stdout: | (launched: 2022-12-09_07:40:37.784906) 07:40:38.267349 run osmo-nitb_10.42.42.2(pid=8473): stderr: | (launched: 2022-12-09_07:40:37.828820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:40:38.400670 run osmo-nitb_10.42.42.2(pid=8473): stdout: | (launched: 2022-12-09_07:40:37.784906) 07:40:38.529437 run osmo-nitb_10.42.42.2(pid=8473): stderr: | (launched: 2022-12-09_07:40:37.828820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8473): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8473) [trial-2356↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8473)] 07:40:38.950026 tst osmo-nitb_10.42.42.2(pid=8473): stdout: | (launched: 2022-12-09_07:40:37.784906) 07:40:39.069491 tst osmo-nitb_10.42.42.2(pid=8473): stderr: | (launched: 2022-12-09_07:40:37.828820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:40:39.209452 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8473): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8473) [trial-2356↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8473)] [trial-2356↪nitb_ussd:trx-lms↪assert_extension.py:12] 07:40:39.218033 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:40:39.224648 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8472): Terminating (SIGTERM) 07:40:39.433935 --- ParallelTerminationStrategy: PID 8472 died... 07:40:39.454866 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8472): Terminated: ok {rc=0} 07:40:39.540509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:trx-lms --------------------------------------------------------------------- 07:40:40.719302 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:40.723523 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 07:40:40.757938 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:40:40.785239 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 07:40:40.821264 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 07:40:40.855170 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:40:40.882087 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 07:40:41.409509 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:trx-lms assert_extension.py ---------------------------------------------- 07:40:41.414332 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:41.424825 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 07:40:41.472103 tst assert_extension.py: using LAC 19949 07:40:41.585980 tst assert_extension.py: using RAC 59 07:40:41.705728 tst assert_extension.py: using CellId 19949 07:40:41.820876 tst assert_extension.py: using BVCI 19950 07:40:41.938557 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:41.949195 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:41.959652 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:41.970424 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:41.981163 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:40:41.991764 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 07:40:42.109907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:42.598074 run create_hlr_db(pid=8477): Launched 07:40:42.726405 bus /sierra_2: Setting Powered False 07:40:43.788249 run create_hlr_db(pid=8477): Terminated: ok {rc=0} 07:40:44.208134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8479): Launched 07:40:44.502292 run osmo-hlr_10.42.42.2(pid=8480): Launched 07:40:44.615245 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:45.135936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8482): Launched 07:40:45.428226 run osmo-stp_10.42.42.5(pid=8483): Launched 07:40:45.539509 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:46.117762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8485): Launched 07:40:46.444875 run osmo-msc_10.42.42.6(pid=8486): Launched 07:40:46.615642 run osmo-stp_10.42.42.5(pid=8483): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8483)] 07:40:46.814840 run osmo-stp_10.42.42.5(pid=8483): stdout: | (launched: 2022-12-09_07:40:45.374305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:47.102866 run osmo-stp_10.42.42.5(pid=8483): stderr: | 20221209074045541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074045541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074045541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074045541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074045542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074045542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074045542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:47.256329 run osmo-stp_10.42.42.5(pid=8483): stdout: | (launched: 2022-12-09_07:40:45.374305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:47.376425 run osmo-stp_10.42.42.5(pid=8483): stderr: | 20221209074045541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074045541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074045541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074045541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074045542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074045542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074045542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:47.519288 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8483): Process ended prematurely: osmo-stp_10.42.42.5(pid=8483) [trial-2356↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8483)] [trial-2356↪ussd:trx-lms↪assert_extension.py:17] 07:40:47.528302 tst assert_extension.py:17: Test FAILED (6.1 sec) 07:40:47.555414 run osmo-hlr_10.42.42.2(pid=8480): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8480)] 07:40:47.604112 run osmo-hlr_10.42.42.2(pid=8480): stdout: | (launched: 2022-12-09_07:40:44.447668) 07:40:47.653810 run osmo-hlr_10.42.42.2(pid=8480): stderr: | 20221209074044619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074044619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074044619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074044619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074044619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074044619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074044631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074044642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074044642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074044642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:47.722955 run osmo-msc_10.42.42.6(pid=8486): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8486)] 07:40:47.770786 run osmo-msc_10.42.42.6(pid=8486): stdout: | (launched: 2022-12-09_07:40:46.389140) 07:40:47.820478 run osmo-msc_10.42.42.6(pid=8486): stderr: | 20221209074046859 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074046859 DLGLOBAL DEBUG validating counter group 0x7f55f2981c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074046860 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074046860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074046861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074046863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074046866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074046866 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074046866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074046866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:47.870611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8479): Terminating (SIGTERM) 07:40:47.910597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8482): Terminating (SIGTERM) 07:40:47.950747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8485): Terminating (SIGTERM) 07:40:47.990853 --- ParallelTerminationStrategy: PID 8479 died... 07:40:48.009759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8479): Terminated: ok {rc=0} 07:40:48.054596 --- ParallelTerminationStrategy: PID 8482 died... 07:40:48.073167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8482): Terminated: ok {rc=0} 07:40:48.117639 --- ParallelTerminationStrategy: PID 8485 died... 07:40:48.136091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8485): Terminated: ok {rc=0} 07:40:48.221623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:40:49.435407 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:49.443649 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:40:49.479667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:40:49.507490 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:40:49.561303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:40:49.594996 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:40:49.622698 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:40:50.172356 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:40:50.221787 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:40:50.232821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:40:50.301684 tst mo_mt_call.py: using LAC 19950 07:40:50.420509 tst mo_mt_call.py: using RAC 60 07:40:50.537242 tst mo_mt_call.py: using CellId 19950 07:40:50.657929 tst mo_mt_call.py: using BVCI 19951 07:40:50.768212 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:40:50.779338 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:40:50.790371 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:40:50.802151 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:40:50.813969 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:40:50.825626 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:40:50.948760 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:40:51.068735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:51.565713 run create_hlr_db(pid=8491): Launched 07:40:51.695359 bus /sierra_2: Setting Powered False 07:40:52.758115 run create_hlr_db(pid=8491): Terminated: ok {rc=0} 07:40:53.183315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8493): Launched 07:40:53.480783 run osmo-hlr_10.42.42.2(pid=8494): Launched 07:40:53.594218 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:54.122215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8496): Launched 07:40:54.420431 run osmo-stp_10.42.42.5(pid=8497): Launched 07:40:54.533559 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:55.072848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8499): Launched 07:40:55.370850 run osmo-msc_10.42.42.6(pid=8500): Launched 07:40:55.538855 run osmo-stp_10.42.42.5(pid=8497): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8497)] 07:40:55.665768 run osmo-stp_10.42.42.5(pid=8497): stdout: | (launched: 2022-12-09_07:40:54.365745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:55.792307 run osmo-stp_10.42.42.5(pid=8497): stderr: | 20221209074054530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074054531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074054531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074054531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074054532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074054532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074054532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:55.916933 run osmo-stp_10.42.42.5(pid=8497): stdout: | (launched: 2022-12-09_07:40:54.365745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:56.035984 run osmo-stp_10.42.42.5(pid=8497): stderr: | 20221209074054530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074054531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074054531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074054531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074054532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074054532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074054532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:56.178482 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8497): Process ended prematurely: osmo-stp_10.42.42.5(pid=8497) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8497)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:40:56.187543 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:40:56.214244 run osmo-hlr_10.42.42.2(pid=8494): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8494)] 07:40:56.261702 run osmo-hlr_10.42.42.2(pid=8494): stdout: | (launched: 2022-12-09_07:40:53.426537) 07:40:56.311005 run osmo-hlr_10.42.42.2(pid=8494): stderr: | 20221209074053617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074053617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074053617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074053617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074053617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074053618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074053630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074053638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074053638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074053638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:56.379225 run osmo-msc_10.42.42.6(pid=8500): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8500)] 07:40:56.426563 run osmo-msc_10.42.42.6(pid=8500): stdout: | (launched: 2022-12-09_07:40:55.316272) 07:40:56.475582 run osmo-msc_10.42.42.6(pid=8500): stderr: | 20221209074055582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074055582 DLGLOBAL DEBUG validating counter group 0x7fa16255bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074055583 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074055583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074055583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074055583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074055585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074055585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074055585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074055585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:56.525390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8493): Terminating (SIGTERM) 07:40:56.565193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8496): Terminating (SIGTERM) 07:40:56.605157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8499): Terminating (SIGTERM) 07:40:56.645218 --- ParallelTerminationStrategy: PID 8493 died... 07:40:56.664164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8493): Terminated: ok {rc=0} 07:40:56.708347 --- ParallelTerminationStrategy: PID 8496 died... 07:40:56.726984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8496): Terminated: ok {rc=0} 07:40:56.771090 --- ParallelTerminationStrategy: PID 8499 died... 07:40:56.789989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8499): Terminated: ok {rc=0} 07:40:56.876545 bus /sierra_3: Setting Powered False 07:40:57.976680 bus /sierra_3: Setting Powered False 07:40:59.092859 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:41:00.238397 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:41:00.250278 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:41:00.320213 tst mo_mt_call_osmux.py: using LAC 19951 07:41:00.438701 tst mo_mt_call_osmux.py: using RAC 61 07:41:00.557593 tst mo_mt_call_osmux.py: using CellId 19951 07:41:00.686460 tst mo_mt_call_osmux.py: using BVCI 19952 07:41:00.802866 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:41:00.814803 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:41:00.826550 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:41:00.859193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:41:00.871326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:41:00.886763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:41:01.009763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:41:01.137660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:01.623065 run create_hlr_db(pid=8502): Launched 07:41:01.777370 bus /sierra_2: Setting Powered False 07:41:02.840529 run create_hlr_db(pid=8502): Terminated: ok {rc=0} 07:41:03.288096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8504): Launched 07:41:03.609054 run osmo-hlr_10.42.42.2(pid=8505): Launched 07:41:03.730559 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:04.280517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8507): Launched 07:41:04.600491 run osmo-stp_10.42.42.5(pid=8508): Launched 07:41:04.723969 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:05.304080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8510): Launched 07:41:05.624552 run osmo-msc_10.42.42.6(pid=8511): Launched 07:41:05.802668 run osmo-stp_10.42.42.5(pid=8508): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8508)] 07:41:05.937529 run osmo-stp_10.42.42.5(pid=8508): stdout: | (launched: 2022-12-09_07:41:04.542090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:06.073915 run osmo-stp_10.42.42.5(pid=8508): stderr: | 20221209074104732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074104732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074104733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074104733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074104733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074104734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074104734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:06.207812 run osmo-stp_10.42.42.5(pid=8508): stdout: | (launched: 2022-12-09_07:41:04.542090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:06.335886 run osmo-stp_10.42.42.5(pid=8508): stderr: | 20221209074104732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074104732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074104733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074104733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074104733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074104734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074104734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:06.488898 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8508): Process ended prematurely: osmo-stp_10.42.42.5(pid=8508) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8508)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:41:06.498849 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:41:06.526923 run osmo-hlr_10.42.42.2(pid=8505): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8505)] 07:41:06.577298 run osmo-hlr_10.42.42.2(pid=8505): stdout: | (launched: 2022-12-09_07:41:03.550478) 07:41:06.629191 run osmo-hlr_10.42.42.2(pid=8505): stderr: | 20221209074103746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074103746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074103746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074103746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074103746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074103746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074103758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074103766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074103766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074103767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:06.702030 run osmo-msc_10.42.42.6(pid=8511): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8511)] 07:41:06.752084 run osmo-msc_10.42.42.6(pid=8511): stdout: | (launched: 2022-12-09_07:41:05.565744) 07:41:06.803363 run osmo-msc_10.42.42.6(pid=8511): stderr: | 20221209074105885 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074105885 DLGLOBAL DEBUG validating counter group 0x7f55a0732c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074105885 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074105885 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074105885 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074105885 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074105887 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074105887 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074105887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074105888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:06.855568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8504): Terminating (SIGTERM) 07:41:06.897446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8507): Terminating (SIGTERM) 07:41:06.939510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8510): Terminating (SIGTERM) 07:41:06.982076 --- ParallelTerminationStrategy: PID 8504 died... 07:41:07.001892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8504): Terminated: ok {rc=0} 07:41:07.048498 --- ParallelTerminationStrategy: PID 8507 died... 07:41:07.068160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8507): Terminated: ok {rc=0} 07:41:07.114514 --- ParallelTerminationStrategy: PID 8510 died... 07:41:07.134187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8510): Terminated: ok {rc=0} 07:41:07.222243 bus /sierra_3: Setting Powered False 07:41:08.321868 bus /sierra_3: Setting Powered False 07:41:09.437713 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:41:10.694078 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:10.701763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:41:10.735896 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:41:10.762847 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:41:10.815584 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:41:10.849332 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:41:10.876007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:41:11.426739 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:41:11.475165 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:11.486430 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:41:11.558952 tst mo_mt_call.py: using LAC 19952 07:41:11.675128 tst mo_mt_call.py: using RAC 62 07:41:11.791499 tst mo_mt_call.py: using CellId 19952 07:41:11.927836 tst mo_mt_call.py: using BVCI 19953 07:41:12.046175 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:12.058055 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:12.069770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:12.081644 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:12.093621 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:12.105470 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:41:12.227397 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:41:12.347892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:12.844066 run create_hlr_db(pid=8516): Launched 07:41:12.974317 bus /sierra_2: Setting Powered False 07:41:14.036358 run create_hlr_db(pid=8516): Terminated: ok {rc=0} 07:41:14.462772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8518): Launched 07:41:14.761193 run osmo-hlr_10.42.42.2(pid=8519): Launched 07:41:14.873905 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:15.386914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8521): Launched 07:41:15.685431 run osmo-stp_10.42.42.5(pid=8522): Launched 07:41:15.799183 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:16.462696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8524): Launched 07:41:16.803868 run osmo-msc_10.42.42.6(pid=8525): Launched 07:41:17.178440 run osmo-stp_10.42.42.5(pid=8522): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8522)] 07:41:17.392609 run osmo-stp_10.42.42.5(pid=8522): stdout: | (launched: 2022-12-09_07:41:15.629845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:17.518791 run osmo-stp_10.42.42.5(pid=8522): stderr: | 20221209074115794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074115794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074115794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074115795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074115795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074115795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074115795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:17.643618 run osmo-stp_10.42.42.5(pid=8522): stdout: | (launched: 2022-12-09_07:41:15.629845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:17.762944 run osmo-stp_10.42.42.5(pid=8522): stderr: | 20221209074115794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074115794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074115794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074115795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074115795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074115795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074115795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:17.906285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8522): Process ended prematurely: osmo-stp_10.42.42.5(pid=8522) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8522)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:41:17.915539 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:41:17.942333 run osmo-hlr_10.42.42.2(pid=8519): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8519)] 07:41:17.990711 run osmo-hlr_10.42.42.2(pid=8519): stdout: | (launched: 2022-12-09_07:41:14.706248) 07:41:18.040367 run osmo-hlr_10.42.42.2(pid=8519): stderr: | 20221209074114878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074114878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074114878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074114878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074114878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074114878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074114895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074114905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074114905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074114906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:18.109454 run osmo-msc_10.42.42.6(pid=8525): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8525)] 07:41:18.157605 run osmo-msc_10.42.42.6(pid=8525): stdout: | (launched: 2022-12-09_07:41:16.744267) 07:41:18.207223 run osmo-msc_10.42.42.6(pid=8525): stderr: | 20221209074117274 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074117274 DLGLOBAL DEBUG validating counter group 0x7fef4e1cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074117274 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074117274 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074117274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074117275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074117276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074117288 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074117288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074117288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:18.257470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8518): Terminating (SIGTERM) 07:41:18.297369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8521): Terminating (SIGTERM) 07:41:18.337186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8524): Terminating (SIGTERM) 07:41:18.377457 --- ParallelTerminationStrategy: PID 8518 died... 07:41:18.396460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8518): Terminated: ok {rc=0} 07:41:18.440715 --- ParallelTerminationStrategy: PID 8521 died... 07:41:18.459406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8521): Terminated: ok {rc=0} 07:41:18.503775 --- ParallelTerminationStrategy: PID 8524 died... 07:41:18.522537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8524): Terminated: ok {rc=0} 07:41:18.607760 bus /sierra_3: Setting Powered False 07:41:19.708085 bus /sierra_3: Setting Powered False 07:41:20.823575 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:41:21.969431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:21.981468 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:41:22.052105 tst mo_mt_call_osmux.py: using LAC 19953 07:41:22.171682 tst mo_mt_call_osmux.py: using RAC 63 07:41:22.289404 tst mo_mt_call_osmux.py: using CellId 19953 07:41:22.410305 tst mo_mt_call_osmux.py: using BVCI 19954 07:41:22.520103 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:22.531421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:22.542586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:22.553900 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:22.565217 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:41:22.576443 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:41:22.692671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:41:22.809099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:23.273331 run create_hlr_db(pid=8527): Launched 07:41:23.386955 bus /sierra_2: Setting Powered False 07:41:24.445646 run create_hlr_db(pid=8527): Terminated: ok {rc=0} 07:41:24.884580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8529): Launched 07:41:25.204561 run osmo-hlr_10.42.42.2(pid=8530): Launched 07:41:25.327691 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:25.878633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8532): Launched 07:41:26.199883 run osmo-stp_10.42.42.5(pid=8533): Launched 07:41:26.320353 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:26.903397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8535): Launched 07:41:27.225117 run osmo-msc_10.42.42.6(pid=8536): Launched 07:41:27.403563 run osmo-stp_10.42.42.5(pid=8533): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8533)] 07:41:27.538525 run osmo-stp_10.42.42.5(pid=8533): stdout: | (launched: 2022-12-09_07:41:26.140922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:27.673249 run osmo-stp_10.42.42.5(pid=8533): stderr: | 20221209074126330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074126330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074126330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074126331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074126331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074126331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074126331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:27.808536 run osmo-stp_10.42.42.5(pid=8533): stdout: | (launched: 2022-12-09_07:41:26.140922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:27.936270 run osmo-stp_10.42.42.5(pid=8533): stderr: | 20221209074126330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074126330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074126330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074126331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074126331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074126331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074126331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:28.090121 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8533): Process ended prematurely: osmo-stp_10.42.42.5(pid=8533) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8533)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:41:28.100068 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:41:28.128269 run osmo-hlr_10.42.42.2(pid=8530): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8530)] 07:41:28.178299 run osmo-hlr_10.42.42.2(pid=8530): stdout: | (launched: 2022-12-09_07:41:25.146295) 07:41:28.230171 run osmo-hlr_10.42.42.2(pid=8530): stderr: | 20221209074125340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074125340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074125340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074125340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074125340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074125340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074125353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074125361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074125362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074125362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:28.302097 run osmo-msc_10.42.42.6(pid=8536): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8536)] 07:41:28.351928 run osmo-msc_10.42.42.6(pid=8536): stdout: | (launched: 2022-12-09_07:41:27.166437) 07:41:28.403449 run osmo-msc_10.42.42.6(pid=8536): stderr: | 20221209074127485 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074127485 DLGLOBAL DEBUG validating counter group 0x7f10b8f92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074127485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074127485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074127485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074127485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074127487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074127487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074127488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074127488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:28.455116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8529): Terminating (SIGTERM) 07:41:28.496605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8532): Terminating (SIGTERM) 07:41:28.538412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8535): Terminating (SIGTERM) 07:41:28.580568 --- ParallelTerminationStrategy: PID 8529 died... 07:41:28.600600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8529): Terminated: ok {rc=0} 07:41:28.647185 --- ParallelTerminationStrategy: PID 8532 died... 07:41:28.666631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8532): Terminated: ok {rc=0} 07:41:28.713145 --- ParallelTerminationStrategy: PID 8535 died... 07:41:28.732643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8535): Terminated: ok {rc=0} 07:41:28.819740 bus /sierra_3: Setting Powered False 07:41:29.917228 bus /sierra_3: Setting Powered False 07:41:31.034383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:41:32.298360 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:32.305412 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:41:32.339918 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:41:32.367835 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:41:32.421585 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:41:32.456163 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:41:32.484424 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:41:33.034743 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:41:33.083791 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:33.095246 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:41:33.166125 tst mo_mt_call.py: using LAC 19954 07:41:33.293819 tst mo_mt_call.py: using RAC 64 07:41:33.418584 tst mo_mt_call.py: using CellId 19954 07:41:33.536907 tst mo_mt_call.py: using BVCI 19955 07:41:33.644788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:33.656176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:33.667378 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:33.678730 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:33.690323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:33.702226 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:41:33.821351 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:41:33.940833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:34.406583 run create_hlr_db(pid=8541): Launched 07:41:34.522782 bus /sierra_2: Setting Powered False 07:41:35.582181 run create_hlr_db(pid=8541): Terminated: ok {rc=0} 07:41:36.021699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8543): Launched 07:41:36.342845 run osmo-hlr_10.42.42.2(pid=8544): Launched 07:41:36.464513 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:37.020332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8546): Launched 07:41:37.340789 run osmo-stp_10.42.42.5(pid=8547): Launched 07:41:37.464324 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:38.047165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8549): Launched 07:41:38.369453 run osmo-msc_10.42.42.6(pid=8550): Launched 07:41:38.548797 run osmo-stp_10.42.42.5(pid=8547): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8547)] 07:41:38.683911 run osmo-stp_10.42.42.5(pid=8547): stdout: | (launched: 2022-12-09_07:41:37.282360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:38.819100 run osmo-stp_10.42.42.5(pid=8547): stderr: | 20221209074137470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074137470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074137470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074137471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074137471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074137471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074137471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:38.953829 run osmo-stp_10.42.42.5(pid=8547): stdout: | (launched: 2022-12-09_07:41:37.282360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:39.081955 run osmo-stp_10.42.42.5(pid=8547): stderr: | 20221209074137470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074137470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074137470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074137471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074137471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074137471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074137471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:39.234771 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8547): Process ended prematurely: osmo-stp_10.42.42.5(pid=8547) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8547)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:41:39.244299 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:41:39.271904 run osmo-hlr_10.42.42.2(pid=8544): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8544)] 07:41:39.321720 run osmo-hlr_10.42.42.2(pid=8544): stdout: | (launched: 2022-12-09_07:41:36.284065) 07:41:39.373263 run osmo-hlr_10.42.42.2(pid=8544): stderr: | 20221209074136477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074136477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074136477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074136477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074136477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074136477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074136490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074136498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074136498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074136498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:39.444623 run osmo-msc_10.42.42.6(pid=8550): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8550)] 07:41:39.494060 run osmo-msc_10.42.42.6(pid=8550): stdout: | (launched: 2022-12-09_07:41:38.310546) 07:41:39.545105 run osmo-msc_10.42.42.6(pid=8550): stderr: | 20221209074138630 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074138631 DLGLOBAL DEBUG validating counter group 0x7f7aef4a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074138631 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074138631 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074138631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074138631 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074138633 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074138633 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074138633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074138633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:39.596670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8543): Terminating (SIGTERM) 07:41:39.637906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8546): Terminating (SIGTERM) 07:41:39.679242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8549): Terminating (SIGTERM) 07:41:39.720699 --- ParallelTerminationStrategy: PID 8543 died... 07:41:39.740540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8543): Terminated: ok {rc=0} 07:41:39.786136 --- ParallelTerminationStrategy: PID 8546 died... 07:41:39.805447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8546): Terminated: ok {rc=0} 07:41:39.851364 --- ParallelTerminationStrategy: PID 8549 died... 07:41:39.870712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8549): Terminated: ok {rc=0} 07:41:39.958484 bus /sierra_3: Setting Powered False 07:41:41.057948 bus /sierra_3: Setting Powered False 07:41:42.174320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:41:43.320376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:43.332210 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:41:43.403105 tst mo_mt_call_osmux.py: using LAC 19955 07:41:43.522335 tst mo_mt_call_osmux.py: using RAC 65 07:41:43.650261 tst mo_mt_call_osmux.py: using CellId 19955 07:41:43.778497 tst mo_mt_call_osmux.py: using BVCI 19956 07:41:43.896430 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:43.908403 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:43.920140 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:43.931777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:43.943287 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:41:43.954718 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:41:44.072079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:41:44.192583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:44.689224 run create_hlr_db(pid=8552): Launched 07:41:44.819919 bus /sierra_2: Setting Powered False 07:41:45.884926 run create_hlr_db(pid=8552): Terminated: ok {rc=0} 07:41:46.343672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8554): Launched 07:41:46.680063 run osmo-hlr_10.42.42.2(pid=8555): Launched 07:41:46.980652 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:47.643727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8557): Launched 07:41:47.942570 run osmo-stp_10.42.42.5(pid=8558): Launched 07:41:48.056135 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:48.597353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8560): Launched 07:41:48.896740 run osmo-msc_10.42.42.6(pid=8561): Launched 07:41:49.063572 run osmo-stp_10.42.42.5(pid=8558): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8558)] 07:41:49.190176 run osmo-stp_10.42.42.5(pid=8558): stdout: | (launched: 2022-12-09_07:41:47.887553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:49.316864 run osmo-stp_10.42.42.5(pid=8558): stderr: | 20221209074148054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074148055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074148055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074148055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074148056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074148056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074148056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:49.441974 run osmo-stp_10.42.42.5(pid=8558): stdout: | (launched: 2022-12-09_07:41:47.887553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:49.561304 run osmo-stp_10.42.42.5(pid=8558): stderr: | 20221209074148054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074148055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074148055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074148055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074148056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074148056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074148056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:49.704206 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8558): Process ended prematurely: osmo-stp_10.42.42.5(pid=8558) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8558)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:41:49.713312 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:41:49.740021 run osmo-hlr_10.42.42.2(pid=8555): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8555)] 07:41:49.787251 run osmo-hlr_10.42.42.2(pid=8555): stdout: | (launched: 2022-12-09_07:41:46.618932) 07:41:49.836412 run osmo-hlr_10.42.42.2(pid=8555): stderr: | 20221209074146999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074146999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074146999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074147000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074147000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074147001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074147029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074147051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074147051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074147051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:49.904565 run osmo-msc_10.42.42.6(pid=8561): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8561)] 07:41:49.951776 run osmo-msc_10.42.42.6(pid=8561): stdout: | (launched: 2022-12-09_07:41:48.841663) 07:41:50.000556 run osmo-msc_10.42.42.6(pid=8561): stderr: | 20221209074149113 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074149113 DLGLOBAL DEBUG validating counter group 0x7f6199ff2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074149113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074149113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074149113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074149113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074149115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074149116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074149116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074149116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:50.049947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8554): Terminating (SIGTERM) 07:41:50.089599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8557): Terminating (SIGTERM) 07:41:50.129238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8560): Terminating (SIGTERM) 07:41:50.169460 --- ParallelTerminationStrategy: PID 8554 died... 07:41:50.188374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8554): Terminated: ok {rc=0} 07:41:50.232417 --- ParallelTerminationStrategy: PID 8557 died... 07:41:50.250803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8557): Terminated: ok {rc=0} 07:41:50.294444 --- ParallelTerminationStrategy: PID 8560 died... 07:41:50.312935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8560): Terminated: ok {rc=0} 07:41:50.398438 bus /sierra_3: Setting Powered False 07:41:51.495945 bus /sierra_3: Setting Powered False 07:41:52.610042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:41:53.859224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:53.865748 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:41:53.900287 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:41:53.927181 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:41:53.979960 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:41:54.013613 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:41:54.040620 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:41:54.591826 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:41:54.640323 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:41:54.651490 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:41:54.720403 tst mo_mt_call.py: using LAC 19956 07:41:54.838796 tst mo_mt_call.py: using RAC 66 07:41:54.957831 tst mo_mt_call.py: using CellId 19956 07:41:55.075519 tst mo_mt_call.py: using BVCI 19957 07:41:55.183457 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:41:55.194682 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:41:55.205720 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:41:55.216806 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:41:55.227964 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:41:55.238940 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:41:55.359363 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:41:55.475661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:55.938244 run create_hlr_db(pid=8567): Launched 07:41:56.053358 bus /sierra_2: Setting Powered False 07:41:57.112867 run create_hlr_db(pid=8567): Terminated: ok {rc=0} 07:41:57.549542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8569): Launched 07:41:57.869995 run osmo-hlr_10.42.42.2(pid=8570): Launched 07:41:57.992774 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:58.549174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8572): Launched 07:41:58.871105 run osmo-stp_10.42.42.5(pid=8573): Launched 07:41:58.994714 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:59.574711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8575): Launched 07:41:59.895665 run osmo-msc_10.42.42.6(pid=8576): Launched 07:42:00.074580 run osmo-stp_10.42.42.5(pid=8573): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8573)] 07:42:00.209507 run osmo-stp_10.42.42.5(pid=8573): stdout: | (launched: 2022-12-09_07:41:58.812516) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:00.344845 run osmo-stp_10.42.42.5(pid=8573): stderr: | 20221209074159001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074159001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074159001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074159001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074159002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074159002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074159002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:00.478473 run osmo-stp_10.42.42.5(pid=8573): stdout: | (launched: 2022-12-09_07:41:58.812516) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:00.605867 run osmo-stp_10.42.42.5(pid=8573): stderr: | 20221209074159001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074159001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074159001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074159001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074159002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074159002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074159002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:00.758103 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8573): Process ended prematurely: osmo-stp_10.42.42.5(pid=8573) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8573)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:42:00.767698 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:42:00.795290 run osmo-hlr_10.42.42.2(pid=8570): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8570)] 07:42:00.849534 run osmo-hlr_10.42.42.2(pid=8570): stdout: | (launched: 2022-12-09_07:41:57.811880) 07:42:00.915017 run osmo-hlr_10.42.42.2(pid=8570): stderr: | 20221209074158005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074158005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074158005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074158005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074158005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074158005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074158019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074158029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074158030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074158030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:01.006582 run osmo-msc_10.42.42.6(pid=8576): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8576)] 07:42:01.090902 run osmo-msc_10.42.42.6(pid=8576): stdout: | (launched: 2022-12-09_07:41:59.836577) 07:42:01.145543 run osmo-msc_10.42.42.6(pid=8576): stderr: | 20221209074200154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074200154 DLGLOBAL DEBUG validating counter group 0x7fcdca1adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074200155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074200155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074200155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074200155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074200157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074200157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074200157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074200157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:01.200605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8569): Terminating (SIGTERM) 07:42:01.245187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8572): Terminating (SIGTERM) 07:42:01.290558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8575): Terminating (SIGTERM) 07:42:01.335096 --- ParallelTerminationStrategy: PID 8569 died... 07:42:01.355723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8569): Terminated: ok {rc=0} 07:42:01.405416 --- ParallelTerminationStrategy: PID 8572 died... 07:42:01.426056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8572): Terminated: ok {rc=0} 07:42:01.475828 --- ParallelTerminationStrategy: PID 8575 died... 07:42:01.496703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8575): Terminated: ok {rc=0} 07:42:01.590483 bus /sierra_3: Setting Powered False 07:42:02.691990 bus /sierra_3: Setting Powered False 07:42:03.810438 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:42:04.955844 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:42:04.967936 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:42:05.038395 tst mo_mt_call_osmux.py: using LAC 19957 07:42:05.157546 tst mo_mt_call_osmux.py: using RAC 67 07:42:05.284427 tst mo_mt_call_osmux.py: using CellId 19957 07:42:05.410405 tst mo_mt_call_osmux.py: using BVCI 19958 07:42:05.522324 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:42:05.533744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:42:05.544763 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:42:05.556063 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:42:05.567456 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:42:05.578755 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:42:05.700241 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:42:05.816423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:06.282131 run create_hlr_db(pid=8585): Launched 07:42:06.396807 bus /sierra_2: Setting Powered False 07:42:07.457086 run create_hlr_db(pid=8585): Terminated: ok {rc=0} 07:42:07.895004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8587): Launched 07:42:08.218085 run osmo-hlr_10.42.42.2(pid=8588): Launched 07:42:08.339616 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:08.891394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8590): Launched 07:42:09.211871 run osmo-stp_10.42.42.5(pid=8591): Launched 07:42:09.332802 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:09.911233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8593): Launched 07:42:10.233532 run osmo-msc_10.42.42.6(pid=8594): Launched 07:42:10.412428 run osmo-stp_10.42.42.5(pid=8591): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8591)] 07:42:10.546828 run osmo-stp_10.42.42.5(pid=8591): stdout: | (launched: 2022-12-09_07:42:09.153485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:10.681692 run osmo-stp_10.42.42.5(pid=8591): stderr: | 20221209074209341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074209341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074209341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074209342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074209342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074209342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074209342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:10.815428 run osmo-stp_10.42.42.5(pid=8591): stdout: | (launched: 2022-12-09_07:42:09.153485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:10.943042 run osmo-stp_10.42.42.5(pid=8591): stderr: | 20221209074209341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074209341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074209341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074209342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074209342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074209342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074209342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:11.096279 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8591): Process ended prematurely: osmo-stp_10.42.42.5(pid=8591) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8591)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:42:11.106060 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:42:11.133611 run osmo-hlr_10.42.42.2(pid=8588): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8588)] 07:42:11.183446 run osmo-hlr_10.42.42.2(pid=8588): stdout: | (launched: 2022-12-09_07:42:08.158806) 07:42:11.234824 run osmo-hlr_10.42.42.2(pid=8588): stderr: | 20221209074208352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074208352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074208352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074208352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074208352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074208352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074208365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074208374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074208374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074208374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:11.306519 run osmo-msc_10.42.42.6(pid=8594): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8594)] 07:42:11.356164 run osmo-msc_10.42.42.6(pid=8594): stdout: | (launched: 2022-12-09_07:42:10.174600) 07:42:11.407334 run osmo-msc_10.42.42.6(pid=8594): stderr: | 20221209074210493 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074210493 DLGLOBAL DEBUG validating counter group 0x7f2c54524c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074210493 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074210493 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074210493 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074210494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074210495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074210496 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074210496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074210496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:11.458713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8587): Terminating (SIGTERM) 07:42:11.499956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8590): Terminating (SIGTERM) 07:42:11.541438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8593): Terminating (SIGTERM) 07:42:11.583081 --- ParallelTerminationStrategy: PID 8587 died... 07:42:11.602458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8587): Terminated: ok {rc=0} 07:42:11.648207 --- ParallelTerminationStrategy: PID 8590 died... 07:42:11.667621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8590): Terminated: ok {rc=0} 07:42:11.713142 --- ParallelTerminationStrategy: PID 8593 died... 07:42:11.732524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8593): Terminated: ok {rc=0} 07:42:11.820357 bus /sierra_3: Setting Powered False 07:42:12.919511 bus /sierra_3: Setting Powered False 07:42:14.037486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:42:15.290639 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:15.297079 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:42:15.331617 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:42:15.358631 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:42:15.411122 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:42:15.445577 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:42:15.472401 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:42:16.043006 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:42:16.097340 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:16.109471 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:42:16.180661 tst mo_mt_call.py: using LAC 19958 07:42:16.350586 tst mo_mt_call.py: using RAC 68 07:42:16.515525 tst mo_mt_call.py: using CellId 19958 07:42:16.639249 tst mo_mt_call.py: using BVCI 19959 07:42:16.752863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:16.765084 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:16.776943 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:16.790124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:16.802942 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:16.817274 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:42:16.965507 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:42:17.098947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:17.603410 run create_hlr_db(pid=8599): Launched 07:42:17.733609 bus /sierra_2: Setting Powered False 07:42:18.797803 run create_hlr_db(pid=8599): Terminated: ok {rc=0} 07:42:19.226299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8601): Launched 07:42:19.528629 run osmo-hlr_10.42.42.2(pid=8602): Launched 07:42:19.642178 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:20.169287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8604): Launched 07:42:20.470288 run osmo-stp_10.42.42.5(pid=8605): Launched 07:42:20.584505 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:21.127816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8607): Launched 07:42:21.427674 run osmo-msc_10.42.42.6(pid=8608): Launched 07:42:21.595373 run osmo-stp_10.42.42.5(pid=8605): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8605)] 07:42:21.722384 run osmo-stp_10.42.42.5(pid=8605): stdout: | (launched: 2022-12-09_07:42:20.414925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:21.849437 run osmo-stp_10.42.42.5(pid=8605): stderr: | 20221209074220581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074220581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074220581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074220582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074220582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074220582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074220582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:21.974322 run osmo-stp_10.42.42.5(pid=8605): stdout: | (launched: 2022-12-09_07:42:20.414925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:22.094398 run osmo-stp_10.42.42.5(pid=8605): stderr: | 20221209074220581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074220581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074220581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074220582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074220582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074220582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074220582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:22.237473 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8605): Process ended prematurely: osmo-stp_10.42.42.5(pid=8605) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8605)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:42:22.246534 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:42:22.273165 run osmo-hlr_10.42.42.2(pid=8602): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8602)] 07:42:22.321248 run osmo-hlr_10.42.42.2(pid=8602): stdout: | (launched: 2022-12-09_07:42:19.473764) 07:42:22.370665 run osmo-hlr_10.42.42.2(pid=8602): stderr: | 20221209074219647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074219647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074219647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074219647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074219647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074219647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074219659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074219671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074219671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074219671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:22.439368 run osmo-msc_10.42.42.6(pid=8608): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8608)] 07:42:22.487063 run osmo-msc_10.42.42.6(pid=8608): stdout: | (launched: 2022-12-09_07:42:21.372244) 07:42:22.536562 run osmo-msc_10.42.42.6(pid=8608): stderr: | 20221209074221638 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074221639 DLGLOBAL DEBUG validating counter group 0x7f87b8f2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074221639 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074221639 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074221639 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074221639 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074221641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074221641 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074221641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074221642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:22.586696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8601): Terminating (SIGTERM) 07:42:22.626339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8604): Terminating (SIGTERM) 07:42:22.666037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8607): Terminating (SIGTERM) 07:42:22.705972 --- ParallelTerminationStrategy: PID 8601 died... 07:42:22.724795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8601): Terminated: ok {rc=0} 07:42:22.768916 --- ParallelTerminationStrategy: PID 8604 died... 07:42:22.787739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8604): Terminated: ok {rc=0} 07:42:22.831879 --- ParallelTerminationStrategy: PID 8607 died... 07:42:22.850371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8607): Terminated: ok {rc=0} 07:42:22.936059 bus /sierra_3: Setting Powered False 07:42:24.034477 bus /sierra_3: Setting Powered False 07:42:25.150620 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:42:26.296748 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:26.308901 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:42:26.382973 tst mo_mt_call_osmux.py: using LAC 19959 07:42:26.503230 tst mo_mt_call_osmux.py: using RAC 69 07:42:26.622405 tst mo_mt_call_osmux.py: using CellId 19959 07:42:26.748224 tst mo_mt_call_osmux.py: using BVCI 19960 07:42:26.864641 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:26.876542 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:26.888134 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:26.900224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:26.912187 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:42:26.924386 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:42:27.042692 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:42:27.159993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:27.625811 run create_hlr_db(pid=8610): Launched 07:42:27.742832 bus /sierra_2: Setting Powered False 07:42:28.802651 run create_hlr_db(pid=8610): Terminated: ok {rc=0} 07:42:29.239594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8612): Launched 07:42:29.560053 run osmo-hlr_10.42.42.2(pid=8613): Launched 07:42:29.682054 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:30.232142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8615): Launched 07:42:30.552039 run osmo-stp_10.42.42.5(pid=8616): Launched 07:42:30.676059 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:31.275055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8618): Launched 07:42:31.607318 run osmo-msc_10.42.42.6(pid=8619): Launched 07:42:31.998349 run osmo-stp_10.42.42.5(pid=8616): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8616)] 07:42:32.254732 run osmo-stp_10.42.42.5(pid=8616): stdout: | (launched: 2022-12-09_07:42:30.493825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:32.402162 run osmo-stp_10.42.42.5(pid=8616): stderr: | 20221209074230683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074230683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074230684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074230684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074230685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074230685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074230685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:32.528559 run osmo-stp_10.42.42.5(pid=8616): stdout: | (launched: 2022-12-09_07:42:30.493825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:32.648478 run osmo-stp_10.42.42.5(pid=8616): stderr: | 20221209074230683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074230683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074230684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074230684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074230685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074230685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074230685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:32.791988 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8616): Process ended prematurely: osmo-stp_10.42.42.5(pid=8616) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8616)] [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:42:32.801280 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:42:32.828299 run osmo-hlr_10.42.42.2(pid=8613): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8613)] 07:42:32.876214 run osmo-hlr_10.42.42.2(pid=8613): stdout: | (launched: 2022-12-09_07:42:29.501734) 07:42:32.925713 run osmo-hlr_10.42.42.2(pid=8613): stderr: | 20221209074229696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074229696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074229696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074229696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074229696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074229696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074229708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074229717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074229717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074229717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:32.994681 run osmo-msc_10.42.42.6(pid=8619): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8619)] 07:42:33.042561 run osmo-msc_10.42.42.6(pid=8619): stdout: | (launched: 2022-12-09_07:42:31.549164) 07:42:33.092098 run osmo-msc_10.42.42.6(pid=8619): stderr: | 20221209074232044 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074232044 DLGLOBAL DEBUG validating counter group 0x7f1294b93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074232044 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074232044 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074232048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074232049 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074232051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074232051 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074232051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074232051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:33.141779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8612): Terminating (SIGTERM) 07:42:33.181820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8615): Terminating (SIGTERM) 07:42:33.221448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8618): Terminating (SIGTERM) 07:42:33.261363 --- ParallelTerminationStrategy: PID 8612 died... 07:42:33.280216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8612): Terminated: ok {rc=0} 07:42:33.324848 --- ParallelTerminationStrategy: PID 8615 died... 07:42:33.343739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8615): Terminated: ok {rc=0} 07:42:33.387888 --- ParallelTerminationStrategy: PID 8618 died... 07:42:33.406478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8618): Terminated: ok {rc=0} 07:42:33.492213 bus /sierra_3: Setting Powered False 07:42:34.590242 bus /sierra_3: Setting Powered False 07:42:35.704665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:42:36.954743 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:36.961195 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:42:36.995056 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:42:37.022190 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:42:37.074878 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:42:37.108363 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:42:37.135094 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:42:37.685478 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:42:37.734014 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:37.745730 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:42:37.815059 tst mo_mt_call.py: using LAC 19960 07:42:37.931849 tst mo_mt_call.py: using RAC 70 07:42:38.049332 tst mo_mt_call.py: using CellId 19960 07:42:38.165233 tst mo_mt_call.py: using BVCI 19961 07:42:38.273552 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:38.284726 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:38.295802 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:38.307119 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:38.318433 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:38.329692 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:42:38.448278 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:42:38.563765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:39.030329 run create_hlr_db(pid=8624): Launched 07:42:39.146752 bus /sierra_2: Setting Powered False 07:42:40.206393 run create_hlr_db(pid=8624): Terminated: ok {rc=0} 07:42:40.645083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Launched 07:42:40.968279 run osmo-hlr_10.42.42.2(pid=8627): Launched 07:42:41.092940 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:41.647500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Launched 07:42:41.969560 run osmo-stp_10.42.42.5(pid=8630): Launched 07:42:42.091418 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:42.670421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8632): Launched 07:42:42.992716 run osmo-msc_10.42.42.6(pid=8633): Launched 07:42:43.171304 run osmo-stp_10.42.42.5(pid=8630): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] 07:42:43.307533 run osmo-stp_10.42.42.5(pid=8630): stdout: | (launched: 2022-12-09_07:42:41.910841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:43.443511 run osmo-stp_10.42.42.5(pid=8630): stderr: | 20221209074242099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074242099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074242099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074242100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074242100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074242100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074242100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:43.577836 run osmo-stp_10.42.42.5(pid=8630): stdout: | (launched: 2022-12-09_07:42:41.910841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:43.705586 run osmo-stp_10.42.42.5(pid=8630): stderr: | 20221209074242099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074242099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074242099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074242100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074242100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074242100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074242100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:43.858711 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8630): Process ended prematurely: osmo-stp_10.42.42.5(pid=8630) [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:42:43.868296 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:42:43.896125 run osmo-hlr_10.42.42.2(pid=8627): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8627)] 07:42:43.946094 run osmo-hlr_10.42.42.2(pid=8627): stdout: | (launched: 2022-12-09_07:42:40.909392) 07:42:43.998010 run osmo-hlr_10.42.42.2(pid=8627): stderr: | 20221209074241103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074241103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074241103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074241103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074241103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074241103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074241116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074241125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074241125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074241125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:44.070401 run osmo-msc_10.42.42.6(pid=8633): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8633)] 07:42:44.120449 run osmo-msc_10.42.42.6(pid=8633): stdout: | (launched: 2022-12-09_07:42:42.933652) 07:42:44.172030 run osmo-msc_10.42.42.6(pid=8633): stderr: | 20221209074243254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074243254 DLGLOBAL DEBUG validating counter group 0x7f2459af7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074243254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074243254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074243254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074243254 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074243256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074243256 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074243256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074243257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:44.223776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Terminating (SIGTERM) 07:42:44.265279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Terminating (SIGTERM) 07:42:44.307093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8632): Terminating (SIGTERM) 07:42:44.348840 --- ParallelTerminationStrategy: PID 8626 died... 07:42:44.368683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Terminated: ok {rc=0} 07:42:44.414568 --- ParallelTerminationStrategy: PID 8629 died... 07:42:44.434240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Terminated: ok {rc=0} 07:42:44.480001 --- ParallelTerminationStrategy: PID 8632 died... 07:42:44.499370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8632): Terminated: ok {rc=0} 07:42:44.586518 bus /sierra_3: Setting Powered False 07:42:45.683678 bus /sierra_3: Setting Powered False 07:42:46.826706 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:42:47.979648 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:47.991582 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:42:48.062839 tst mo_mt_call_osmux.py: using LAC 19961 07:42:48.182390 tst mo_mt_call_osmux.py: using RAC 71 07:42:48.300012 tst mo_mt_call_osmux.py: using CellId 19961 07:42:48.417632 tst mo_mt_call_osmux.py: using BVCI 19962 07:42:48.528379 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:48.539829 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:48.550860 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:48.562143 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:48.573599 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:42:48.584859 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:42:48.704508 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:42:48.822435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:49.324181 run create_hlr_db(pid=8635): Launched 07:42:49.455340 bus /sierra_2: Setting Powered False 07:42:50.518705 run create_hlr_db(pid=8635): Terminated: ok {rc=0} 07:42:50.966155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Launched 07:42:51.287886 run osmo-hlr_10.42.42.2(pid=8638): Launched 07:42:51.410048 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:51.962290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Launched 07:42:52.283548 run osmo-stp_10.42.42.5(pid=8641): Launched 07:42:52.406859 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:52.993433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Launched 07:42:53.314551 run osmo-msc_10.42.42.6(pid=8644): Launched 07:42:53.496143 run osmo-stp_10.42.42.5(pid=8641): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] 07:42:53.631783 run osmo-stp_10.42.42.5(pid=8641): stdout: | (launched: 2022-12-09_07:42:52.224589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:53.767347 run osmo-stp_10.42.42.5(pid=8641): stderr: | 20221209074252411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074252411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074252411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074252412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074252412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074252412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074252412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:53.902067 run osmo-stp_10.42.42.5(pid=8641): stdout: | (launched: 2022-12-09_07:42:52.224589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:54.030634 run osmo-stp_10.42.42.5(pid=8641): stderr: | 20221209074252411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074252411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074252411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074252412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074252412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074252412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074252412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:54.183974 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8641): Process ended prematurely: osmo-stp_10.42.42.5(pid=8641) [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:42:54.193682 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:42:54.221364 run osmo-hlr_10.42.42.2(pid=8638): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8638)] 07:42:54.271282 run osmo-hlr_10.42.42.2(pid=8638): stdout: | (launched: 2022-12-09_07:42:51.229192) 07:42:54.322809 run osmo-hlr_10.42.42.2(pid=8638): stderr: | 20221209074251422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074251422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074251422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074251422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074251422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074251422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074251435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074251443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074251443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074251444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:54.394437 run osmo-msc_10.42.42.6(pid=8644): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8644)] 07:42:54.444135 run osmo-msc_10.42.42.6(pid=8644): stdout: | (launched: 2022-12-09_07:42:53.255665) 07:42:54.495521 run osmo-msc_10.42.42.6(pid=8644): stderr: | 20221209074253573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074253574 DLGLOBAL DEBUG validating counter group 0x7f280e808c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074253574 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074253574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074253574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074253574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074253576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074253576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074253576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074253576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:54.547067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Terminating (SIGTERM) 07:42:54.588139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Terminating (SIGTERM) 07:42:54.629565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Terminating (SIGTERM) 07:42:54.671100 --- ParallelTerminationStrategy: PID 8637 died... 07:42:54.690943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Terminated: ok {rc=0} 07:42:54.736682 --- ParallelTerminationStrategy: PID 8640 died... 07:42:54.756061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Terminated: ok {rc=0} 07:42:54.801967 --- ParallelTerminationStrategy: PID 8643 died... 07:42:54.821263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Terminated: ok {rc=0} 07:42:54.908781 bus /sierra_3: Setting Powered False 07:42:56.007985 bus /sierra_3: Setting Powered False 07:42:57.125786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:42:58.373848 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:58.379455 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:42:58.413580 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:42:58.440362 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:42:58.494608 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:42:58.529501 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:42:58.557562 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:42:59.106632 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:42:59.155418 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:42:59.166612 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:42:59.235359 tst mo_mt_call.py: using LAC 19962 07:42:59.353362 tst mo_mt_call.py: using RAC 72 07:42:59.473461 tst mo_mt_call.py: using CellId 19962 07:42:59.593418 tst mo_mt_call.py: using BVCI 19963 07:42:59.703039 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:42:59.714190 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:42:59.725288 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:42:59.736447 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:42:59.747642 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:42:59.758868 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:42:59.876382 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:42:59.991816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:00.459007 run create_hlr_db(pid=8649): Launched 07:43:00.573983 bus /sierra_2: Setting Powered False 07:43:01.633365 run create_hlr_db(pid=8649): Terminated: ok {rc=0} 07:43:02.060546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Launched 07:43:02.375064 run osmo-hlr_10.42.42.2(pid=8652): Launched 07:43:02.489736 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:03.017461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Launched 07:43:03.339570 run osmo-stp_10.42.42.5(pid=8655): Launched 07:43:03.460705 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:04.042939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Launched 07:43:04.365961 run osmo-msc_10.42.42.6(pid=8658): Launched 07:43:04.545357 run osmo-stp_10.42.42.5(pid=8655): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] 07:43:04.679911 run osmo-stp_10.42.42.5(pid=8655): stdout: | (launched: 2022-12-09_07:43:03.281089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:04.814918 run osmo-stp_10.42.42.5(pid=8655): stderr: | 20221209074303470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074303470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074303470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074303471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074303471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074303471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074303471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:04.948868 run osmo-stp_10.42.42.5(pid=8655): stdout: | (launched: 2022-12-09_07:43:03.281089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:05.077625 run osmo-stp_10.42.42.5(pid=8655): stderr: | 20221209074303470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074303470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074303470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074303471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074303471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074303471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074303471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:05.230781 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8655): Process ended prematurely: osmo-stp_10.42.42.5(pid=8655) [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:43:05.240526 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:43:05.268341 run osmo-hlr_10.42.42.2(pid=8652): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8652)] 07:43:05.318469 run osmo-hlr_10.42.42.2(pid=8652): stdout: | (launched: 2022-12-09_07:43:02.319932) 07:43:05.369865 run osmo-hlr_10.42.42.2(pid=8652): stderr: | 20221209074302489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074302489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074302489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074302489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074302490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074302490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074302502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074302510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074302510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074302510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:05.441788 run osmo-msc_10.42.42.6(pid=8658): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8658)] 07:43:05.491267 run osmo-msc_10.42.42.6(pid=8658): stdout: | (launched: 2022-12-09_07:43:04.307031) 07:43:05.542454 run osmo-msc_10.42.42.6(pid=8658): stderr: | 20221209074304628 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074304629 DLGLOBAL DEBUG validating counter group 0x7fedf4380c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074304629 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074304629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074304629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074304629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074304631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074304631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074304631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074304632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:05.594723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Terminating (SIGTERM) 07:43:05.635885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Terminating (SIGTERM) 07:43:05.677038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Terminating (SIGTERM) 07:43:05.718392 --- ParallelTerminationStrategy: PID 8651 died... 07:43:05.738122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Terminated: ok {rc=0} 07:43:05.784101 --- ParallelTerminationStrategy: PID 8654 died... 07:43:05.803420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Terminated: ok {rc=0} 07:43:05.849199 --- ParallelTerminationStrategy: PID 8657 died... 07:43:05.868483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Terminated: ok {rc=0} 07:43:05.955539 bus /sierra_3: Setting Powered False 07:43:07.054645 bus /sierra_3: Setting Powered False 07:43:08.171138 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:43:09.320283 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:43:09.332686 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:43:09.405997 tst mo_mt_call_osmux.py: using LAC 19963 07:43:09.533530 tst mo_mt_call_osmux.py: using RAC 73 07:43:09.661283 tst mo_mt_call_osmux.py: using CellId 19963 07:43:09.788835 tst mo_mt_call_osmux.py: using BVCI 19964 07:43:09.905069 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:43:09.916447 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:43:09.927654 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:43:09.938901 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:43:09.950155 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:43:09.961474 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:43:10.078125 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:43:10.198967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:10.699091 run create_hlr_db(pid=8660): Launched 07:43:10.829559 bus /sierra_2: Setting Powered False 07:43:11.893819 run create_hlr_db(pid=8660): Terminated: ok {rc=0} 07:43:12.323013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Launched 07:43:12.623997 run osmo-hlr_10.42.42.2(pid=8663): Launched 07:43:12.737908 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:13.268900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Launched 07:43:13.569078 run osmo-stp_10.42.42.5(pid=8666): Launched 07:43:13.683694 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:14.228940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Launched 07:43:14.529682 run osmo-msc_10.42.42.6(pid=8669): Launched 07:43:14.697685 run osmo-stp_10.42.42.5(pid=8666): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] 07:43:14.827098 run osmo-stp_10.42.42.5(pid=8666): stdout: | (launched: 2022-12-09_07:43:13.513839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:14.953688 run osmo-stp_10.42.42.5(pid=8666): stderr: | 20221209074313679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074313679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074313679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074313680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074313680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074313681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074313681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:15.078750 run osmo-stp_10.42.42.5(pid=8666): stdout: | (launched: 2022-12-09_07:43:13.513839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:15.199066 run osmo-stp_10.42.42.5(pid=8666): stderr: | 20221209074313679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074313679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074313679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074313680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074313680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074313681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074313681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:15.342709 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8666): Process ended prematurely: osmo-stp_10.42.42.5(pid=8666) [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:43:15.351594 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:43:15.378677 run osmo-hlr_10.42.42.2(pid=8663): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8663)] 07:43:15.427058 run osmo-hlr_10.42.42.2(pid=8663): stdout: | (launched: 2022-12-09_07:43:12.568300) 07:43:15.477047 run osmo-hlr_10.42.42.2(pid=8663): stderr: | 20221209074312742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074312742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074312742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074312742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074312742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074312742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074312756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074312765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074312765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074312766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:15.546345 run osmo-msc_10.42.42.6(pid=8669): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8669)] 07:43:15.594761 run osmo-msc_10.42.42.6(pid=8669): stdout: | (launched: 2022-12-09_07:43:14.473876) 07:43:15.644429 run osmo-msc_10.42.42.6(pid=8669): stderr: | 20221209074314742 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074314742 DLGLOBAL DEBUG validating counter group 0x7f8d86491c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074314742 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074314742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074314742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074314742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074314744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074314744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074314745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074314745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:15.695019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Terminating (SIGTERM) 07:43:15.735198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Terminating (SIGTERM) 07:43:15.775343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Terminating (SIGTERM) 07:43:15.815779 --- ParallelTerminationStrategy: PID 8662 died... 07:43:15.835493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Terminated: ok {rc=0} 07:43:15.895139 --- ParallelTerminationStrategy: PID 8665 died... 07:43:15.915202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Terminated: ok {rc=0} 07:43:15.960768 --- ParallelTerminationStrategy: PID 8668 died... 07:43:15.980147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Terminated: ok {rc=0} 07:43:16.065406 bus /sierra_3: Setting Powered False 07:43:17.164193 bus /sierra_3: Setting Powered False 07:43:18.285733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:trx-lms --------------------------------------------------------------------- 07:43:19.534242 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:43:19.539766 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 07:43:19.574690 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:43:19.602378 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 07:43:19.689180 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 07:43:19.724395 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:43:19.752095 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 07:43:20.338870 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 07:43:20.344073 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:20.355208 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 07:43:20.405974 tst emergency_mo_mt_call.py: using LAC 19964 07:43:20.529674 tst emergency_mo_mt_call.py: using RAC 74 07:43:20.652162 tst emergency_mo_mt_call.py: using CellId 19964 07:43:20.774296 tst emergency_mo_mt_call.py: using BVCI 19965 07:43:20.888354 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:20.899633 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:20.910693 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:20.921706 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:20.932635 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:20.943594 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:43:21.057886 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:43:21.175190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:21.634751 run create_hlr_db(pid=8674): Launched 07:43:21.749963 bus /sierra_2: Setting Powered False 07:43:22.812645 run create_hlr_db(pid=8674): Terminated: ok {rc=0} 07:43:23.254238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Launched 07:43:23.571903 run osmo-hlr_10.42.42.2(pid=8677): Launched 07:43:23.693429 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:24.241412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Launched 07:43:24.556753 run osmo-stp_10.42.42.5(pid=8680): Launched 07:43:24.688743 tst emergency_mo_mt_call.py: using MSISDN 7092 07:43:24.852764 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:25.424124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Launched 07:43:25.739425 run osmo-msc_10.42.42.6(pid=8683): Launched 07:43:25.916855 run osmo-stp_10.42.42.5(pid=8680): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] 07:43:26.050449 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-09_07:43:24.498896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:26.184247 run osmo-stp_10.42.42.5(pid=8680): stderr: | 20221209074324687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074324687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074324687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074324688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074324688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074324688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074324688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:26.317338 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-09_07:43:24.498896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:26.442778 run osmo-stp_10.42.42.5(pid=8680): stderr: | 20221209074324687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074324687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074324687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074324688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074324688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074324688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074324688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:26.593287 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2356↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] [trial-2356↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 07:43:26.602371 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 07:43:26.629894 run osmo-hlr_10.42.42.2(pid=8677): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8677)] 07:43:26.680173 run osmo-hlr_10.42.42.2(pid=8677): stdout: | (launched: 2022-12-09_07:43:23.513754) 07:43:26.731810 run osmo-hlr_10.42.42.2(pid=8677): stderr: | 20221209074323706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074323706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074323706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074323706 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074323707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074323707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074323720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074323730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074323730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074323731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:26.803936 run osmo-msc_10.42.42.6(pid=8683): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8683)] 07:43:26.853820 run osmo-msc_10.42.42.6(pid=8683): stdout: | (launched: 2022-12-09_07:43:25.681381) 07:43:26.905083 run osmo-msc_10.42.42.6(pid=8683): stderr: | 20221209074326000 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074326000 DLGLOBAL DEBUG validating counter group 0x7f32ce07fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074326000 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074326001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074326001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074326001 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074326003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074326003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074326003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074326003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:26.956428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminating (SIGTERM) 07:43:26.997509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminating (SIGTERM) 07:43:27.039423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Terminating (SIGTERM) 07:43:27.081742 --- ParallelTerminationStrategy: PID 8676 died... 07:43:27.101784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminated: ok {rc=0} 07:43:27.148027 --- ParallelTerminationStrategy: PID 8679 died... 07:43:27.167653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminated: ok {rc=0} 07:43:27.213843 --- ParallelTerminationStrategy: PID 8682 died... 07:43:27.233453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Terminated: ok {rc=0} 07:43:27.321682 bus /sierra_3: Setting Powered False 07:43:28.420136 bus /sierra_3: Setting Powered False 07:43:29.534731 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 07:43:30.621225 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:30.633416 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 07:43:30.686545 tst emergency_preemptive_call.py: using LAC 19965 07:43:30.812343 tst emergency_preemptive_call.py: using RAC 75 07:43:30.950373 tst emergency_preemptive_call.py: using CellId 19965 07:43:31.090566 tst emergency_preemptive_call.py: using BVCI 19966 07:43:31.234700 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:31.246830 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:31.259047 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:31.272402 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:31.285473 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:43:31.297158 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:43:31.434702 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:43:31.577402 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:43:31.711148 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:43:31.833054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:32.354577 run create_hlr_db(pid=8685): Launched 07:43:32.483277 bus /sierra_2: Setting Powered False 07:43:33.546038 run create_hlr_db(pid=8685): Terminated: ok {rc=0} 07:43:33.986930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Launched 07:43:34.304465 run osmo-hlr_10.42.42.2(pid=8688): Launched 07:43:34.425236 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:34.972679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Launched 07:43:35.289168 run osmo-stp_10.42.42.5(pid=8691): Launched 07:43:35.417835 tst emergency_preemptive_call.py: using MSISDN 7093 07:43:35.578812 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:36.147084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Launched 07:43:36.464102 run osmo-msc_10.42.42.6(pid=8694): Launched 07:43:36.639657 run osmo-stp_10.42.42.5(pid=8691): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] 07:43:36.772471 run osmo-stp_10.42.42.5(pid=8691): stdout: | (launched: 2022-12-09_07:43:35.230606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:36.906045 run osmo-stp_10.42.42.5(pid=8691): stderr: | 20221209074335418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074335419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074335419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074335419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074335420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074335420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074335420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:37.039103 run osmo-stp_10.42.42.5(pid=8691): stdout: | (launched: 2022-12-09_07:43:35.230606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:37.164679 run osmo-stp_10.42.42.5(pid=8691): stderr: | 20221209074335418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074335419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074335419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074335419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074335420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074335420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074335420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:37.314945 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8691): Process ended prematurely: osmo-stp_10.42.42.5(pid=8691) [trial-2356↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] [trial-2356↪emergency:trx-lms↪emergency_preemptive_call.py:32] 07:43:37.324247 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 07:43:37.351785 run osmo-hlr_10.42.42.2(pid=8688): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8688)] 07:43:37.401832 run osmo-hlr_10.42.42.2(pid=8688): stdout: | (launched: 2022-12-09_07:43:34.246439) 07:43:37.453895 run osmo-hlr_10.42.42.2(pid=8688): stderr: | 20221209074334439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074334439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074334439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074334439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074334440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074334440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074334455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074334463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074334464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074334464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:37.526343 run osmo-msc_10.42.42.6(pid=8694): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8694)] 07:43:37.576354 run osmo-msc_10.42.42.6(pid=8694): stdout: | (launched: 2022-12-09_07:43:36.406183) 07:43:37.627994 run osmo-msc_10.42.42.6(pid=8694): stderr: | 20221209074336723 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074336723 DLGLOBAL DEBUG validating counter group 0x7f4325359c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074336723 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074336723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074336723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074336724 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074336725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074336726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074336726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074336726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:37.679787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Terminating (SIGTERM) 07:43:37.721360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Terminating (SIGTERM) 07:43:37.762913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Terminating (SIGTERM) 07:43:37.804804 --- ParallelTerminationStrategy: PID 8687 died... 07:43:37.824566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Terminated: ok {rc=0} 07:43:37.871182 --- ParallelTerminationStrategy: PID 8690 died... 07:43:37.890815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Terminated: ok {rc=0} 07:43:37.937158 --- ParallelTerminationStrategy: PID 8693 died... 07:43:37.956788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Terminated: ok {rc=0} 07:43:38.045611 bus /sierra_9: Setting Powered False 07:43:39.145689 bus /sierra_9: Setting Powered False 07:43:40.261830 bus /sierra_8: Setting Powered False 07:43:41.360579 bus /sierra_8: Setting Powered False 07:43:42.478185 bus /sierra_3: Setting Powered False 07:43:43.578018 bus /sierra_3: Setting Powered False 07:43:44.696845 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms --------------------------------------------------------------------- 07:43:45.996251 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:43:46.005662 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 07:43:46.055121 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 07:43:46.108508 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 07:43:46.215774 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 07:43:46.261007 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 07:43:46.313092 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 07:43:46.923084 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 07:43:46.994210 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.009720 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:43:47.077514 tst cs_paging_gprs_active.py: using LAC 19966 07:43:47.232219 tst cs_paging_gprs_active.py: using RAC 76 07:43:47.363570 tst cs_paging_gprs_active.py: using CellId 19966 07:43:47.489406 tst cs_paging_gprs_active.py: using BVCI 19967 07:43:47.599665 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.610608 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.621344 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.632397 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.643662 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.654686 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.665870 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.676934 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:47.687806 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:43:47.807548 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:43:47.926865 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:43:48.145890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:48.469544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8700): Launched 07:43:48.750089 run iperf3-srv_10.42.42.10(pid=8701): Launched 07:43:48.870677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:43:49.088930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:49.413228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8702): Launched 07:43:49.693449 run iperf3-srv_10.42.42.10(pid=8703): Launched 07:43:49.816510 tst cs_paging_gprs_active.py:38: start network... 07:43:50.034114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:50.534424 run create_hlr_db(pid=8704): Launched 07:43:50.667407 bus /sierra_2: Setting Powered False 07:43:51.731129 run create_hlr_db(pid=8704): Terminated: ok {rc=0} 07:43:52.162698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Launched 07:43:52.464129 run osmo-hlr_10.42.42.2(pid=8707): Launched 07:43:52.578249 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:53.110167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Launched 07:43:53.411740 run osmo-stp_10.42.42.5(pid=8710): Launched 07:43:53.526031 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:43:54.046523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8712): Launched 07:43:54.161788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:43:54.416545 run patchelf(pid=8713): Launched 07:43:54.583865 run osmo-stp_10.42.42.5(pid=8710): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] 07:43:54.711792 run osmo-stp_10.42.42.5(pid=8710): stdout: | (launched: 2022-12-09_07:43:53.356101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:54.840772 run osmo-stp_10.42.42.5(pid=8710): stderr: | 20221209074353522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074353522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074353523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074353523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074353524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074353524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074353524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:54.970024 run osmo-stp_10.42.42.5(pid=8710): stdout: | (launched: 2022-12-09_07:43:53.356101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:55.093426 run osmo-stp_10.42.42.5(pid=8710): stderr: | 20221209074353522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074353522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074353523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074353523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074353524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074353524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074353524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:55.239610 run patchelf(pid=8713): Terminating (SIGINT) 07:43:55.407566 run patchelf(pid=8713): Terminated: ok {rc=0} 07:43:55.528713 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8710): Process ended prematurely: osmo-stp_10.42.42.5(pid=8710) [trial-2356↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] [trial-2356↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 07:43:55.538412 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:43:55.566302 run osmo-hlr_10.42.42.2(pid=8707): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8707)] 07:43:55.614481 run osmo-hlr_10.42.42.2(pid=8707): stdout: | (launched: 2022-12-09_07:43:52.408543) 07:43:55.664166 run osmo-hlr_10.42.42.2(pid=8707): stderr: | 20221209074352581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074352581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074352581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074352581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074352581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074352581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074352594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074352605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074352605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074352605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:55.714567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8700): Terminating (SIGTERM) 07:43:55.754546 run iperf3-srv_10.42.42.10(pid=8701): Terminating (SIGTERM) 07:43:55.794414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8702): Terminating (SIGTERM) 07:43:55.834646 run iperf3-srv_10.42.42.10(pid=8703): Terminating (SIGTERM) 07:43:55.874445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Terminating (SIGTERM) 07:43:55.914414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Terminating (SIGTERM) 07:43:55.954196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8712): Terminating (SIGTERM) 07:43:55.994537 --- ParallelTerminationStrategy: PID 8700 died... 07:43:56.013647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8700): Terminated: ok {rc=0} 07:43:56.058196 --- ParallelTerminationStrategy: PID 8701 died... 07:43:56.076785 run iperf3-srv_10.42.42.10(pid=8701): Terminated {rc=256} 07:43:56.121384 --- ParallelTerminationStrategy: PID 8702 died... 07:43:56.140151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8702): Terminated: ok {rc=0} 07:43:56.184630 --- ParallelTerminationStrategy: PID 8703 died... 07:43:56.203459 run iperf3-srv_10.42.42.10(pid=8703): Terminated {rc=256} 07:43:56.247887 --- ParallelTerminationStrategy: PID 8706 died... 07:43:56.266662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Terminated: ok {rc=0} 07:43:56.311136 --- ParallelTerminationStrategy: PID 8709 died... 07:43:56.329780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Terminated: ok {rc=0} 07:43:56.374156 --- ParallelTerminationStrategy: PID 8712 died... 07:43:56.392859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8712): Terminated: ok {rc=0} 07:43:56.476912 bus /gobi_0: Setting Powered False 07:43:57.571530 bus /gobi_0: Setting Powered False 07:43:58.684056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms iperf3.py ---------------------------------------------- 07:43:59.832806 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:59.844785 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:43:59.898812 tst iperf3.py: using LAC 19967 07:44:00.029523 tst iperf3.py: using RAC 77 07:44:00.149287 tst iperf3.py: using CellId 19967 07:44:00.266140 tst iperf3.py: using BVCI 19968 07:44:00.374959 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.385909 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.396591 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.407408 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.418054 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.428511 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.439306 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.450010 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:00.460673 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:00.575248 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:44:00.777712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:01.123519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8714): Launched 07:44:01.448119 run iperf3-srv_10.42.42.10(pid=8715): Launched 07:44:01.585913 tst iperf3.py:8: start network... 07:44:01.810934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:02.325848 run create_hlr_db(pid=8716): Launched 07:44:02.457491 bus /gobi_6: Setting Powered False 07:44:03.521650 run create_hlr_db(pid=8716): Terminated: ok {rc=0} 07:44:03.970896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8718): Launched 07:44:04.297222 run osmo-hlr_10.42.42.2(pid=8719): Launched 07:44:04.419591 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:04.977628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8721): Launched 07:44:05.299343 run osmo-stp_10.42.42.5(pid=8722): Launched 07:44:05.422859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:05.976811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8724): Launched 07:44:06.102164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:06.374704 run patchelf(pid=8725): Launched 07:44:06.553248 run osmo-stp_10.42.42.5(pid=8722): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8722)] 07:44:06.689944 run osmo-stp_10.42.42.5(pid=8722): stdout: | (launched: 2022-12-09_07:44:05.240518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:06.827704 run osmo-stp_10.42.42.5(pid=8722): stderr: | 20221209074405429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074405430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074405430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074405430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074405431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074405431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074405431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:06.965830 run osmo-stp_10.42.42.5(pid=8722): stdout: | (launched: 2022-12-09_07:44:05.240518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:07.098874 run osmo-stp_10.42.42.5(pid=8722): stderr: | 20221209074405429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074405430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074405430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074405430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074405431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074405431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074405431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:07.255612 run patchelf(pid=8725): Terminating (SIGINT) 07:44:07.435303 run patchelf(pid=8725): Terminated: ok {rc=0} 07:44:07.564667 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8722): Process ended prematurely: osmo-stp_10.42.42.5(pid=8722) [trial-2356↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8722)] [trial-2356↪gprs:trx-lms↪iperf3.py:8] 07:44:07.575024 tst iperf3.py:8: Test FAILED (7.8 sec) 07:44:07.603368 run osmo-hlr_10.42.42.2(pid=8719): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8719)] 07:44:07.653203 run osmo-hlr_10.42.42.2(pid=8719): stdout: | (launched: 2022-12-09_07:44:04.237633) 07:44:07.704778 run osmo-hlr_10.42.42.2(pid=8719): stderr: | 20221209074404433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074404433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074404433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074404433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074404433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074404433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074404446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074404455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074404455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074404455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:07.756786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8714): Terminating (SIGTERM) 07:44:07.798322 run iperf3-srv_10.42.42.10(pid=8715): Terminating (SIGTERM) 07:44:07.839962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8718): Terminating (SIGTERM) 07:44:07.881744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8721): Terminating (SIGTERM) 07:44:07.923485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8724): Terminating (SIGTERM) 07:44:07.965361 --- ParallelTerminationStrategy: PID 8714 died... 07:44:07.985386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8714): Terminated: ok {rc=0} 07:44:08.031511 --- ParallelTerminationStrategy: PID 8715 died... 07:44:08.051392 run iperf3-srv_10.42.42.10(pid=8715): Terminated {rc=256} 07:44:08.097739 --- ParallelTerminationStrategy: PID 8718 died... 07:44:08.117284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8718): Terminated: ok {rc=0} 07:44:08.162907 --- ParallelTerminationStrategy: PID 8721 died... 07:44:08.182600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8721): Terminated: ok {rc=0} 07:44:08.228766 --- ParallelTerminationStrategy: PID 8724 died... 07:44:08.248528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8724): Terminated: ok {rc=0} 07:44:08.336910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms iperf3m4.py ---------------------------------------------- 07:44:09.486690 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:09.498676 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:44:09.549766 tst iperf3m4.py: using LAC 19968 07:44:09.679754 tst iperf3m4.py: using RAC 78 07:44:09.805447 tst iperf3m4.py: using CellId 19968 07:44:09.929133 tst iperf3m4.py: using BVCI 19969 07:44:10.045536 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.056690 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.067768 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.078750 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.089828 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.100679 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.112009 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.122973 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:10.133998 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:10.250644 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:10.378547 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:10.495787 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:10.614349 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:44:10.816741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:11.118357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8726): Launched 07:44:11.381298 run iperf3-srv_10.42.42.10(pid=8727): Launched 07:44:11.494285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:44:11.696567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:11.999269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8728): Launched 07:44:12.262222 run iperf3-srv_10.42.42.10(pid=8729): Launched 07:44:12.375539 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:44:12.577655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:12.880245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8730): Launched 07:44:13.141772 run iperf3-srv_10.42.42.10(pid=8731): Launched 07:44:13.253726 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:44:13.454816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:13.755954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8732): Launched 07:44:14.016900 run iperf3-srv_10.42.42.10(pid=8733): Launched 07:44:14.130033 tst iperf3m4.py:8: start network... 07:44:14.331674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:14.798414 run create_hlr_db(pid=8734): Launched 07:44:14.913893 bus /gobi_6: Setting Powered False 07:44:15.988211 run create_hlr_db(pid=8734): Terminated: ok {rc=0} 07:44:16.419071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8736): Launched 07:44:16.737512 run osmo-hlr_10.42.42.2(pid=8737): Launched 07:44:16.903216 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:17.637607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8739): Launched 07:44:17.961233 run osmo-stp_10.42.42.5(pid=8740): Launched 07:44:18.085670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:18.640490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8742): Launched 07:44:18.762668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:19.034577 run patchelf(pid=8743): Launched 07:44:19.213645 run osmo-stp_10.42.42.5(pid=8740): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8740)] 07:44:19.349649 run osmo-stp_10.42.42.5(pid=8740): stdout: | (launched: 2022-12-09_07:44:17.902189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:19.487002 run osmo-stp_10.42.42.5(pid=8740): stderr: | 20221209074418089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074418089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074418089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074418090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074418090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074418090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074418090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:19.624812 run osmo-stp_10.42.42.5(pid=8740): stdout: | (launched: 2022-12-09_07:44:17.902189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:19.756174 run osmo-stp_10.42.42.5(pid=8740): stderr: | 20221209074418089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074418089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074418089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074418090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074418090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074418090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074418090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:19.914055 run patchelf(pid=8743): Terminating (SIGINT) 07:44:20.092920 run patchelf(pid=8743): Terminated: ok {rc=0} 07:44:20.222975 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8740): Process ended prematurely: osmo-stp_10.42.42.5(pid=8740) [trial-2356↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8740)] [trial-2356↪gprs:trx-lms↪iperf3m4.py:8] 07:44:20.233380 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:44:20.262098 run osmo-hlr_10.42.42.2(pid=8737): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8737)] 07:44:20.311831 run osmo-hlr_10.42.42.2(pid=8737): stdout: | (launched: 2022-12-09_07:44:16.680842) 07:44:20.363401 run osmo-hlr_10.42.42.2(pid=8737): stderr: | 20221209074416993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074416993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074416993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074416993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074416993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074416993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074417006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074417022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074417022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074417022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:20.415006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8726): Terminating (SIGTERM) 07:44:20.456501 run iperf3-srv_10.42.42.10(pid=8727): Terminating (SIGTERM) 07:44:20.497929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8728): Terminating (SIGTERM) 07:44:20.539713 run iperf3-srv_10.42.42.10(pid=8729): Terminating (SIGTERM) 07:44:20.581278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8730): Terminating (SIGTERM) 07:44:20.622914 run iperf3-srv_10.42.42.10(pid=8731): Terminating (SIGTERM) 07:44:20.664174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8732): Terminating (SIGTERM) 07:44:20.705498 run iperf3-srv_10.42.42.10(pid=8733): Terminating (SIGTERM) 07:44:20.746783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8736): Terminating (SIGTERM) 07:44:20.788310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8739): Terminating (SIGTERM) 07:44:20.830016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8742): Terminating (SIGTERM) 07:44:20.871745 --- ParallelTerminationStrategy: PID 8726 died... 07:44:20.891659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8726): Terminated: ok {rc=0} 07:44:20.937889 --- ParallelTerminationStrategy: PID 8727 died... 07:44:20.957397 run iperf3-srv_10.42.42.10(pid=8727): Terminated {rc=256} 07:44:21.004006 --- ParallelTerminationStrategy: PID 8728 died... 07:44:21.023536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8728): Terminated: ok {rc=0} 07:44:21.068413 --- ParallelTerminationStrategy: PID 8729 died... 07:44:21.086854 run iperf3-srv_10.42.42.10(pid=8729): Terminated {rc=256} 07:44:21.131960 --- ParallelTerminationStrategy: PID 8730 died... 07:44:21.150425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8730): Terminated: ok {rc=0} 07:44:21.195417 --- ParallelTerminationStrategy: PID 8731 died... 07:44:21.213778 run iperf3-srv_10.42.42.10(pid=8731): Terminated {rc=256} 07:44:21.258801 --- ParallelTerminationStrategy: PID 8732 died... 07:44:21.277202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8732): Terminated: ok {rc=0} 07:44:21.321957 --- ParallelTerminationStrategy: PID 8733 died... 07:44:21.340327 run iperf3-srv_10.42.42.10(pid=8733): Terminated {rc=256} 07:44:21.385426 --- ParallelTerminationStrategy: PID 8736 died... 07:44:21.403904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8736): Terminated: ok {rc=0} 07:44:21.448755 --- ParallelTerminationStrategy: PID 8739 died... 07:44:21.467315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8739): Terminated: ok {rc=0} 07:44:21.512476 --- ParallelTerminationStrategy: PID 8742 died... 07:44:21.531075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8742): Terminated: ok {rc=0} 07:44:21.617826 bus /gobi_4: Setting Powered False 07:44:22.716112 bus /gobi_4: Setting Powered False 07:44:23.831381 bus /gobi_1: Setting Powered False 07:44:24.926542 bus /gobi_1: Setting Powered False 07:44:26.041513 bus /gobi_0: Setting Powered False 07:44:27.139423 bus /gobi_0: Setting Powered False 07:44:28.256760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms ping.py ---------------------------------------------- 07:44:29.358386 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.370350 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:44:29.424393 tst ping.py: using LAC 19969 07:44:29.546999 tst ping.py: using RAC 79 07:44:29.668716 tst ping.py: using CellId 19969 07:44:29.790343 tst ping.py: using BVCI 19970 07:44:29.905741 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.916825 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.927852 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.938732 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.949508 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.960254 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.971303 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:29.982289 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:30.096846 tst ping.py:19: start network... 07:44:30.294146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:30.751255 run create_hlr_db(pid=8745): Launched 07:44:30.865988 bus /gobi_6: Setting Powered False 07:44:31.940670 run create_hlr_db(pid=8745): Terminated: ok {rc=0} 07:44:32.395018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8747): Launched 07:44:32.689648 run osmo-hlr_10.42.42.2(pid=8748): Launched 07:44:32.802956 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:33.323739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8750): Launched 07:44:33.617541 run osmo-stp_10.42.42.5(pid=8751): Launched 07:44:33.729570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:34.235915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8753): Launched 07:44:34.347973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:34.596930 run patchelf(pid=8754): Launched 07:44:34.761220 run osmo-stp_10.42.42.5(pid=8751): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8751)] 07:44:34.886397 run osmo-stp_10.42.42.5(pid=8751): stdout: | (launched: 2022-12-09_07:44:33.563098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:35.013469 run osmo-stp_10.42.42.5(pid=8751): stderr: | 20221209074433731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074433731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074433732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074433732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074433733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074433733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074433733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:35.140470 run osmo-stp_10.42.42.5(pid=8751): stdout: | (launched: 2022-12-09_07:44:33.563098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:35.261835 run osmo-stp_10.42.42.5(pid=8751): stderr: | 20221209074433731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074433731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074433732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074433732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074433733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074433733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074433733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:35.405714 run patchelf(pid=8754): Terminating (SIGINT) 07:44:35.570700 run patchelf(pid=8754): Terminated: ok {rc=0} 07:44:35.690149 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8751): Process ended prematurely: osmo-stp_10.42.42.5(pid=8751) [trial-2356↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8751)] [trial-2356↪gprs:trx-lms↪ping.py:22] 07:44:35.699299 tst ping.py:22: Test FAILED (6.3 sec) 07:44:35.726281 run osmo-hlr_10.42.42.2(pid=8748): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8748)] 07:44:35.774120 run osmo-hlr_10.42.42.2(pid=8748): stdout: | (launched: 2022-12-09_07:44:32.635291) 07:44:35.823620 run osmo-hlr_10.42.42.2(pid=8748): stderr: | 20221209074432806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074432806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074432806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074432806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074432806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074432806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074432818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074432828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074432828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074432828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:35.873533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8747): Terminating (SIGTERM) 07:44:35.913473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8750): Terminating (SIGTERM) 07:44:35.953170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8753): Terminating (SIGTERM) 07:44:35.992942 --- ParallelTerminationStrategy: PID 8747 died... 07:44:36.011976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8747): Terminated: ok {rc=0} 07:44:36.056820 --- ParallelTerminationStrategy: PID 8750 died... 07:44:36.075653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8750): Terminated: ok {rc=0} 07:44:36.119862 --- ParallelTerminationStrategy: PID 8753 died... 07:44:36.138772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8753): Terminated: ok {rc=0} 07:44:36.224904 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 07:44:37.312392 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.323972 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:44:37.376124 tst ping_idle_ping.py: using LAC 19970 07:44:37.494018 tst ping_idle_ping.py: using RAC 80 07:44:37.612927 tst ping_idle_ping.py: using CellId 19970 07:44:37.729363 tst ping_idle_ping.py: using BVCI 19971 07:44:37.838273 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.849023 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.859605 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.870859 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.882153 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.893354 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.904669 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:44:37.915944 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:44:38.036439 tst ping_idle_ping.py:24: start network... 07:44:38.252467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:38.749985 run create_hlr_db(pid=8755): Launched 07:44:38.881353 bus /gobi_6: Setting Powered False 07:44:39.944793 run create_hlr_db(pid=8755): Terminated: ok {rc=0} 07:44:40.370226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8757): Launched 07:44:40.667489 run osmo-hlr_10.42.42.2(pid=8758): Launched 07:44:40.780615 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:41.307512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8760): Launched 07:44:41.602722 run osmo-stp_10.42.42.5(pid=8761): Launched 07:44:41.715193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:42.226409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8763): Launched 07:44:42.339749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:42.591732 run patchelf(pid=8764): Launched 07:44:42.756811 run osmo-stp_10.42.42.5(pid=8761): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8761)] 07:44:42.882346 run osmo-stp_10.42.42.5(pid=8761): stdout: | (launched: 2022-12-09_07:44:41.547925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:43.009416 run osmo-stp_10.42.42.5(pid=8761): stderr: | 20221209074441715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074441716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074441716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074441716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074441717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074441717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074441717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:43.136474 run osmo-stp_10.42.42.5(pid=8761): stdout: | (launched: 2022-12-09_07:44:41.547925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:43.258276 run osmo-stp_10.42.42.5(pid=8761): stderr: | 20221209074441715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074441716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074441716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074441716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074441717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074441717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074441717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:43.402593 run patchelf(pid=8764): Terminating (SIGINT) 07:44:43.567667 run patchelf(pid=8764): Terminated: ok {rc=0} 07:44:43.687214 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8761): Process ended prematurely: osmo-stp_10.42.42.5(pid=8761) [trial-2356↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8761)] [trial-2356↪gprs:trx-lms↪ping_idle_ping.py:27] 07:44:43.696143 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:44:43.723249 run osmo-hlr_10.42.42.2(pid=8758): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8758)] 07:44:43.771487 run osmo-hlr_10.42.42.2(pid=8758): stdout: | (launched: 2022-12-09_07:44:40.612659) 07:44:43.821194 run osmo-hlr_10.42.42.2(pid=8758): stderr: | 20221209074440784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074440784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074440784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074440784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074440784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074440784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074440796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074440805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074440805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074440805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:43.871040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8757): Terminating (SIGTERM) 07:44:43.911006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8760): Terminating (SIGTERM) 07:44:43.951039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8763): Terminating (SIGTERM) 07:44:43.991293 --- ParallelTerminationStrategy: PID 8757 died... 07:44:44.010426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8757): Terminated: ok {rc=0} 07:44:44.054738 --- ParallelTerminationStrategy: PID 8760 died... 07:44:44.073679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8760): Terminated: ok {rc=0} 07:44:44.118459 --- ParallelTerminationStrategy: PID 8763 died... 07:44:44.137134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8763): Terminated: ok {rc=0} 07:44:44.220514 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 07:44:45.524379 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:44:45.530687 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:44:45.566132 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:44:45.606481 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:44:45.697919 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:44:45.733225 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:44:45.773543 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:44:46.366537 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:44:46.419507 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:46.431411 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:44:46.485929 tst cs_paging_gprs_active.py: using LAC 19971 07:44:46.637099 tst cs_paging_gprs_active.py: using RAC 81 07:44:46.772053 tst cs_paging_gprs_active.py: using CellId 19971 07:44:46.901597 tst cs_paging_gprs_active.py: using BVCI 19972 07:44:47.043090 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.055198 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.067349 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.079504 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.091431 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.103496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.115699 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.127685 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:47.139616 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:44:47.264112 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:44:47.384636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:44:47.603731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:47.929104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8768): Launched 07:44:48.210898 run iperf3-srv_10.42.42.10(pid=8769): Launched 07:44:48.333621 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:44:48.551831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:48.876741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8770): Launched 07:44:49.158154 run iperf3-srv_10.42.42.10(pid=8771): Launched 07:44:49.280393 tst cs_paging_gprs_active.py:38: start network... 07:44:49.498616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:50.000911 run create_hlr_db(pid=8772): Launched 07:44:50.132602 bus /gobi_6: Setting Powered False 07:44:51.197184 run create_hlr_db(pid=8772): Terminated: ok {rc=0} 07:44:51.647709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8774): Launched 07:44:51.971994 run osmo-hlr_10.42.42.2(pid=8775): Launched 07:44:52.095370 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:52.651255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8777): Launched 07:44:52.974310 run osmo-stp_10.42.42.5(pid=8778): Launched 07:44:53.098659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:53.656266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8780): Launched 07:44:53.779195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:54.053853 run patchelf(pid=8781): Launched 07:44:54.234780 run osmo-stp_10.42.42.5(pid=8778): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8778)] 07:44:54.371232 run osmo-stp_10.42.42.5(pid=8778): stdout: | (launched: 2022-12-09_07:44:52.915288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:54.509464 run osmo-stp_10.42.42.5(pid=8778): stderr: | 20221209074453106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074453106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074453106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074453106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074453107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074453107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074453107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:54.647448 run osmo-stp_10.42.42.5(pid=8778): stdout: | (launched: 2022-12-09_07:44:52.915288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:54.779504 run osmo-stp_10.42.42.5(pid=8778): stderr: | 20221209074453106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074453106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074453106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074453106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074453107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074453107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074453107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:54.936000 run patchelf(pid=8781): Terminating (SIGINT) 07:44:55.116682 run patchelf(pid=8781): Terminated: ok {rc=0} 07:44:55.246733 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8778): Process ended prematurely: osmo-stp_10.42.42.5(pid=8778) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8778)] [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:44:55.256997 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 07:44:55.285641 run osmo-hlr_10.42.42.2(pid=8775): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8775)] 07:44:55.335689 run osmo-hlr_10.42.42.2(pid=8775): stdout: | (launched: 2022-12-09_07:44:51.912447) 07:44:55.387187 run osmo-hlr_10.42.42.2(pid=8775): stderr: | 20221209074452109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074452109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074452109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074452109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074452109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074452109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074452122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074452130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074452131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074452131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:55.439139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8768): Terminating (SIGTERM) 07:44:55.480787 run iperf3-srv_10.42.42.10(pid=8769): Terminating (SIGTERM) 07:44:55.522472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8770): Terminating (SIGTERM) 07:44:55.564345 run iperf3-srv_10.42.42.10(pid=8771): Terminating (SIGTERM) 07:44:55.606288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8774): Terminating (SIGTERM) 07:44:55.648226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8777): Terminating (SIGTERM) 07:44:55.690244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8780): Terminating (SIGTERM) 07:44:55.732430 --- ParallelTerminationStrategy: PID 8768 died... 07:44:55.752508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8768): Terminated: ok {rc=0} 07:44:55.798932 --- ParallelTerminationStrategy: PID 8769 died... 07:44:55.818637 run iperf3-srv_10.42.42.10(pid=8769): Terminated {rc=256} 07:44:55.864759 --- ParallelTerminationStrategy: PID 8770 died... 07:44:55.884515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8770): Terminated: ok {rc=0} 07:44:55.930562 --- ParallelTerminationStrategy: PID 8771 died... 07:44:55.950013 run iperf3-srv_10.42.42.10(pid=8771): Terminated {rc=256} 07:44:55.995992 --- ParallelTerminationStrategy: PID 8774 died... 07:44:56.015786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8774): Terminated: ok {rc=0} 07:44:56.062109 --- ParallelTerminationStrategy: PID 8777 died... 07:44:56.082323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8777): Terminated: ok {rc=0} 07:44:56.128745 --- ParallelTerminationStrategy: PID 8780 died... 07:44:56.148352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8780): Terminated: ok {rc=0} 07:44:56.237301 bus /gobi_0: Setting Powered False 07:44:57.336630 bus /gobi_0: Setting Powered False 07:44:58.453010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:44:59.602725 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:59.615114 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:44:59.667997 tst iperf3.py: using LAC 19972 07:44:59.795276 tst iperf3.py: using RAC 82 07:44:59.921139 tst iperf3.py: using CellId 19972 07:45:00.047309 tst iperf3.py: using BVCI 19973 07:45:00.166770 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.178429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.189737 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.201049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.212596 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.224073 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.235538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.246970 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:00.258539 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:00.376697 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:45:00.595588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:00.921155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8782): Launched 07:45:01.218372 run iperf3-srv_10.42.42.10(pid=8783): Launched 07:45:01.375339 tst iperf3.py:8: start network... 07:45:01.634883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:02.145639 run create_hlr_db(pid=8787): Launched 07:45:02.306817 bus /gobi_6: Setting Powered False 07:45:03.370624 run create_hlr_db(pid=8787): Terminated: ok {rc=0} 07:45:03.804043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8789): Launched 07:45:04.106194 run osmo-hlr_10.42.42.2(pid=8790): Launched 07:45:04.220932 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:04.753126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8792): Launched 07:45:05.055026 run osmo-stp_10.42.42.5(pid=8793): Launched 07:45:05.170381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:05.688636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8795): Launched 07:45:05.803751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:06.058188 run patchelf(pid=8796): Launched 07:45:06.224568 run osmo-stp_10.42.42.5(pid=8793): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8793)] 07:45:06.351272 run osmo-stp_10.42.42.5(pid=8793): stdout: | (launched: 2022-12-09_07:45:04.999010) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:06.479512 run osmo-stp_10.42.42.5(pid=8793): stderr: | 20221209074505165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074505165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074505166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074505166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074505167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074505167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074505167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:06.608522 run osmo-stp_10.42.42.5(pid=8793): stdout: | (launched: 2022-12-09_07:45:04.999010) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:06.731449 run osmo-stp_10.42.42.5(pid=8793): stderr: | 20221209074505165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074505165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074505166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074505166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074505167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074505167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074505167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:06.876895 run patchelf(pid=8796): Terminating (SIGINT) 07:45:07.044297 run patchelf(pid=8796): Terminated: ok {rc=0} 07:45:07.165829 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8793): Process ended prematurely: osmo-stp_10.42.42.5(pid=8793) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8793)] [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 07:45:07.175309 tst iperf3.py:8: Test FAILED (7.6 sec) 07:45:07.202846 run osmo-hlr_10.42.42.2(pid=8790): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8790)] 07:45:07.250792 run osmo-hlr_10.42.42.2(pid=8790): stdout: | (launched: 2022-12-09_07:45:04.050329) 07:45:07.300472 run osmo-hlr_10.42.42.2(pid=8790): stderr: | 20221209074504223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074504223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074504223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074504223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074504223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074504223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074504235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074504244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074504244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074504244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:07.350766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8782): Terminating (SIGTERM) 07:45:07.390779 run iperf3-srv_10.42.42.10(pid=8783): Terminating (SIGTERM) 07:45:07.430632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8789): Terminating (SIGTERM) 07:45:07.470376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8792): Terminating (SIGTERM) 07:45:07.510290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8795): Terminating (SIGTERM) 07:45:07.550206 --- ParallelTerminationStrategy: PID 8782 died... 07:45:07.569299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8782): Terminated: ok {rc=0} 07:45:07.613619 --- ParallelTerminationStrategy: PID 8783 died... 07:45:07.632065 run iperf3-srv_10.42.42.10(pid=8783): Terminated {rc=256} 07:45:07.676219 --- ParallelTerminationStrategy: PID 8789 died... 07:45:07.694776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8789): Terminated: ok {rc=0} 07:45:07.738843 --- ParallelTerminationStrategy: PID 8792 died... 07:45:07.757334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8792): Terminated: ok {rc=0} 07:45:07.801367 --- ParallelTerminationStrategy: PID 8795 died... 07:45:07.819787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8795): Terminated: ok {rc=0} 07:45:07.903941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:45:09.045826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.057496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:45:09.109048 tst iperf3m4.py: using LAC 19973 07:45:09.227183 tst iperf3m4.py: using RAC 83 07:45:09.344782 tst iperf3m4.py: using CellId 19973 07:45:09.476779 tst iperf3m4.py: using BVCI 19974 07:45:09.595882 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.607565 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.619024 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.630622 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.642168 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.653703 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.665485 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.676616 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:09.688050 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:09.807105 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:09.928497 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:10.045837 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:10.166959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:45:10.385951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:10.711403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8797): Launched 07:45:10.997787 run iperf3-srv_10.42.42.10(pid=8798): Launched 07:45:11.112513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:45:11.315744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:11.620614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8799): Launched 07:45:11.882860 run iperf3-srv_10.42.42.10(pid=8800): Launched 07:45:11.996126 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:45:12.198625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:12.501680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8801): Launched 07:45:12.763854 run iperf3-srv_10.42.42.10(pid=8802): Launched 07:45:12.876431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:45:13.078477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:13.381359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8803): Launched 07:45:13.643108 run iperf3-srv_10.42.42.10(pid=8804): Launched 07:45:13.755797 tst iperf3m4.py:8: start network... 07:45:13.957912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:14.427726 run create_hlr_db(pid=8805): Launched 07:45:14.543240 bus /gobi_6: Setting Powered False 07:45:15.603157 run create_hlr_db(pid=8805): Terminated: ok {rc=0} 07:45:16.063498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8807): Launched 07:45:16.385682 run osmo-hlr_10.42.42.2(pid=8808): Launched 07:45:16.544568 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:17.185891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8810): Launched 07:45:17.494988 run osmo-stp_10.42.42.5(pid=8811): Launched 07:45:17.610118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:18.130121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8813): Launched 07:45:18.244807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:18.499802 run patchelf(pid=8814): Launched 07:45:18.667010 run osmo-stp_10.42.42.5(pid=8811): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8811)] 07:45:18.794064 run osmo-stp_10.42.42.5(pid=8811): stdout: | (launched: 2022-12-09_07:45:17.439031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:18.922926 run osmo-stp_10.42.42.5(pid=8811): stderr: | 20221209074517603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074517603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074517603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074517604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074517604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074517604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074517604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:19.051392 run osmo-stp_10.42.42.5(pid=8811): stdout: | (launched: 2022-12-09_07:45:17.439031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:19.174694 run osmo-stp_10.42.42.5(pid=8811): stderr: | 20221209074517603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074517603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074517603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074517604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074517604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074517604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074517604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:19.320560 run patchelf(pid=8814): Terminating (SIGINT) 07:45:19.489314 run patchelf(pid=8814): Terminated: ok {rc=0} 07:45:19.610963 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8811): Process ended prematurely: osmo-stp_10.42.42.5(pid=8811) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8811)] [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 07:45:19.620427 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:45:19.648075 run osmo-hlr_10.42.42.2(pid=8808): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8808)] 07:45:19.696537 run osmo-hlr_10.42.42.2(pid=8808): stdout: | (launched: 2022-12-09_07:45:16.326199) 07:45:19.746138 run osmo-hlr_10.42.42.2(pid=8808): stderr: | 20221209074516668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074516668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074516668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074516668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074516668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074516668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074516683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074516700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074516700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074516700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:19.796094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8797): Terminating (SIGTERM) 07:45:19.836338 run iperf3-srv_10.42.42.10(pid=8798): Terminating (SIGTERM) 07:45:19.876224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8799): Terminating (SIGTERM) 07:45:19.916207 run iperf3-srv_10.42.42.10(pid=8800): Terminating (SIGTERM) 07:45:19.956052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8801): Terminating (SIGTERM) 07:45:19.995899 run iperf3-srv_10.42.42.10(pid=8802): Terminating (SIGTERM) 07:45:20.035552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8803): Terminating (SIGTERM) 07:45:20.075562 run iperf3-srv_10.42.42.10(pid=8804): Terminating (SIGTERM) 07:45:20.115349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8807): Terminating (SIGTERM) 07:45:20.155359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8810): Terminating (SIGTERM) 07:45:20.195205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8813): Terminating (SIGTERM) 07:45:20.235563 --- ParallelTerminationStrategy: PID 8797 died... 07:45:20.254678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8797): Terminated: ok {rc=0} 07:45:20.299032 --- ParallelTerminationStrategy: PID 8798 died... 07:45:20.317679 run iperf3-srv_10.42.42.10(pid=8798): Terminated {rc=256} 07:45:20.361868 --- ParallelTerminationStrategy: PID 8799 died... 07:45:20.380397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8799): Terminated: ok {rc=0} 07:45:20.425181 --- ParallelTerminationStrategy: PID 8800 died... 07:45:20.443820 run iperf3-srv_10.42.42.10(pid=8800): Terminated {rc=256} 07:45:20.488566 --- ParallelTerminationStrategy: PID 8801 died... 07:45:20.507312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8801): Terminated: ok {rc=0} 07:45:20.551651 --- ParallelTerminationStrategy: PID 8802 died... 07:45:20.570280 run iperf3-srv_10.42.42.10(pid=8802): Terminated {rc=256} 07:45:20.614317 --- ParallelTerminationStrategy: PID 8803 died... 07:45:20.633094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8803): Terminated: ok {rc=0} 07:45:20.678080 --- ParallelTerminationStrategy: PID 8804 died... 07:45:20.696938 run iperf3-srv_10.42.42.10(pid=8804): Terminated {rc=256} 07:45:20.741623 --- ParallelTerminationStrategy: PID 8807 died... 07:45:20.760255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8807): Terminated: ok {rc=0} 07:45:20.804209 --- ParallelTerminationStrategy: PID 8810 died... 07:45:20.822965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8810): Terminated: ok {rc=0} 07:45:20.867480 --- ParallelTerminationStrategy: PID 8813 died... 07:45:20.886244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8813): Terminated: ok {rc=0} 07:45:20.971987 bus /gobi_4: Setting Powered False 07:45:22.071623 bus /gobi_4: Setting Powered False 07:45:23.186641 bus /gobi_1: Setting Powered False 07:45:24.285265 bus /gobi_1: Setting Powered False 07:45:25.400652 bus /gobi_0: Setting Powered False 07:45:26.499141 bus /gobi_0: Setting Powered False 07:45:27.616824 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 07:45:28.720687 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:28.732894 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:45:28.785439 tst ping.py: using LAC 19974 07:45:28.903313 tst ping.py: using RAC 84 07:45:29.021390 tst ping.py: using CellId 19974 07:45:29.148105 tst ping.py: using BVCI 19975 07:45:29.256355 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.267382 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.278163 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.289119 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.299970 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.310903 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.322087 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:29.333006 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:29.447065 tst ping.py:19: start network... 07:45:29.644508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:30.103542 run create_hlr_db(pid=8815): Launched 07:45:30.215183 bus /gobi_6: Setting Powered False 07:45:31.274259 run create_hlr_db(pid=8815): Terminated: ok {rc=0} 07:45:31.697306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8817): Launched 07:45:32.021705 run osmo-hlr_10.42.42.2(pid=8818): Launched 07:45:32.218250 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:32.770178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8820): Launched 07:45:33.086519 run osmo-stp_10.42.42.5(pid=8821): Launched 07:45:33.206582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:33.755066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8823): Launched 07:45:33.876452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:34.146621 run patchelf(pid=8824): Launched 07:45:34.323232 run osmo-stp_10.42.42.5(pid=8821): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8821)] 07:45:34.457403 run osmo-stp_10.42.42.5(pid=8821): stdout: | (launched: 2022-12-09_07:45:33.027841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:34.593531 run osmo-stp_10.42.42.5(pid=8821): stderr: | 20221209074533216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074533216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074533216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074533217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074533217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074533217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074533217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:34.729621 run osmo-stp_10.42.42.5(pid=8821): stdout: | (launched: 2022-12-09_07:45:33.027841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:34.860806 run osmo-stp_10.42.42.5(pid=8821): stderr: | 20221209074533216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074533216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074533216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074533217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074533217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074533217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074533217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:35.015217 run patchelf(pid=8824): Terminating (SIGINT) 07:45:35.192160 run patchelf(pid=8824): Terminated: ok {rc=0} 07:45:35.319707 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8821): Process ended prematurely: osmo-stp_10.42.42.5(pid=8821) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8821)] [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 07:45:35.329459 tst ping.py:22: Test FAILED (6.6 sec) 07:45:35.357656 run osmo-hlr_10.42.42.2(pid=8818): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8818)] 07:45:35.407748 run osmo-hlr_10.42.42.2(pid=8818): stdout: | (launched: 2022-12-09_07:45:31.955103) 07:45:35.459409 run osmo-hlr_10.42.42.2(pid=8818): stderr: | 20221209074532232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074532232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074532233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074532233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074532233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074532233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074532244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074532252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074532253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074532253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:35.511461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8817): Terminating (SIGTERM) 07:45:35.553476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8820): Terminating (SIGTERM) 07:45:35.595677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8823): Terminating (SIGTERM) 07:45:35.637875 --- ParallelTerminationStrategy: PID 8817 died... 07:45:35.658007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8817): Terminated: ok {rc=0} 07:45:35.704479 --- ParallelTerminationStrategy: PID 8820 died... 07:45:35.723793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8820): Terminated: ok {rc=0} 07:45:35.769950 --- ParallelTerminationStrategy: PID 8823 died... 07:45:35.789652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8823): Terminated: ok {rc=0} 07:45:35.876758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:45:36.963748 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:36.976042 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:45:37.028858 tst ping_idle_ping.py: using LAC 19975 07:45:37.147569 tst ping_idle_ping.py: using RAC 85 07:45:37.264009 tst ping_idle_ping.py: using CellId 19975 07:45:37.381571 tst ping_idle_ping.py: using BVCI 19976 07:45:37.499240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.510981 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.522565 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.534053 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.545423 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.556693 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.568103 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:45:37.579428 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:45:37.695382 tst ping_idle_ping.py:24: start network... 07:45:37.895601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:38.360091 run create_hlr_db(pid=8825): Launched 07:45:38.474322 bus /gobi_6: Setting Powered False 07:45:39.533869 run create_hlr_db(pid=8825): Terminated: ok {rc=0} 07:45:39.970818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8827): Launched 07:45:40.291612 run osmo-hlr_10.42.42.2(pid=8828): Launched 07:45:40.413441 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:40.963354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8830): Launched 07:45:41.282721 run osmo-stp_10.42.42.5(pid=8831): Launched 07:45:41.404550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:41.954551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8833): Launched 07:45:42.076205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:42.347188 run patchelf(pid=8834): Launched 07:45:42.524262 run osmo-stp_10.42.42.5(pid=8831): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8831)] 07:45:42.659048 run osmo-stp_10.42.42.5(pid=8831): stdout: | (launched: 2022-12-09_07:45:41.223705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:42.795069 run osmo-stp_10.42.42.5(pid=8831): stderr: | 20221209074541412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074541412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074541413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074541413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074541413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074541414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074541414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:42.931509 run osmo-stp_10.42.42.5(pid=8831): stdout: | (launched: 2022-12-09_07:45:41.223705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:43.061492 run osmo-stp_10.42.42.5(pid=8831): stderr: | 20221209074541412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074541412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074541413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074541413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074541413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074541414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074541414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:43.216717 run patchelf(pid=8834): Terminating (SIGINT) 07:45:43.393815 run patchelf(pid=8834): Terminated: ok {rc=0} 07:45:43.521640 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8831): Process ended prematurely: osmo-stp_10.42.42.5(pid=8831) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8831)] [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 07:45:43.531216 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:45:43.559549 run osmo-hlr_10.42.42.2(pid=8828): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8828)] 07:45:43.609558 run osmo-hlr_10.42.42.2(pid=8828): stdout: | (launched: 2022-12-09_07:45:40.233152) 07:45:43.661278 run osmo-hlr_10.42.42.2(pid=8828): stderr: | 20221209074540427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074540427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074540427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074540427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074540427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074540427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074540441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074540449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074540450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074540450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:43.713316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8827): Terminating (SIGTERM) 07:45:43.755276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8830): Terminating (SIGTERM) 07:45:43.797402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8833): Terminating (SIGTERM) 07:45:43.839649 --- ParallelTerminationStrategy: PID 8827 died... 07:45:43.859769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8827): Terminated: ok {rc=0} 07:45:43.906414 --- ParallelTerminationStrategy: PID 8830 died... 07:45:43.926030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8830): Terminated: ok {rc=0} 07:45:43.972140 --- ParallelTerminationStrategy: PID 8833 died... 07:45:43.991894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8833): Terminated: ok {rc=0} 07:45:44.079814 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:45:45.379576 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:45:45.385595 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:45:45.419919 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:45:45.458991 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:45:45.550007 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:45:45.584853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:45:45.623688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:45:46.262803 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:45:46.316610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:46.328812 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:45:46.400631 tst cs_paging_gprs_active.py: using LAC 19976 07:45:46.560109 tst cs_paging_gprs_active.py: using RAC 86 07:45:46.696873 tst cs_paging_gprs_active.py: using CellId 19976 07:45:46.849549 tst cs_paging_gprs_active.py: using BVCI 19977 07:45:46.979276 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:46.990838 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.002392 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.014183 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.025667 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.037051 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.048491 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.059974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:47.071732 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:45:47.197556 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:45:47.315260 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:45:47.519742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:47.825335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8838): Launched 07:45:48.089266 run iperf3-srv_10.42.42.10(pid=8839): Launched 07:45:48.202328 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:45:48.405337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:48.709640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8840): Launched 07:45:48.972546 run iperf3-srv_10.42.42.10(pid=8841): Launched 07:45:49.085897 tst cs_paging_gprs_active.py:38: start network... 07:45:49.289432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:49.758027 run create_hlr_db(pid=8842): Launched 07:45:49.873745 bus /gobi_6: Setting Powered False 07:45:50.934793 run create_hlr_db(pid=8842): Terminated: ok {rc=0} 07:45:51.376540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8844): Launched 07:45:51.698223 run osmo-hlr_10.42.42.2(pid=8845): Launched 07:45:51.819764 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:52.373397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8847): Launched 07:45:52.694266 run osmo-stp_10.42.42.5(pid=8848): Launched 07:45:52.815871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:53.372256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8850): Launched 07:45:53.494871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:53.774653 run patchelf(pid=8851): Launched 07:45:53.954197 run osmo-stp_10.42.42.5(pid=8848): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8848)] 07:45:54.090741 run osmo-stp_10.42.42.5(pid=8848): stdout: | (launched: 2022-12-09_07:45:52.634742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:54.229190 run osmo-stp_10.42.42.5(pid=8848): stderr: | 20221209074552822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074552822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074552822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074552823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074552823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074552823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074552823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:54.367408 run osmo-stp_10.42.42.5(pid=8848): stdout: | (launched: 2022-12-09_07:45:52.634742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:54.500164 run osmo-stp_10.42.42.5(pid=8848): stderr: | 20221209074552822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074552822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074552822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074552823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074552823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074552823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074552823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:54.657356 run patchelf(pid=8851): Terminating (SIGINT) 07:45:54.837789 run patchelf(pid=8851): Terminated: ok {rc=0} 07:45:54.968628 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8848): Process ended prematurely: osmo-stp_10.42.42.5(pid=8848) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8848)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:45:54.978944 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:45:55.007598 run osmo-hlr_10.42.42.2(pid=8845): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8845)] 07:45:55.057357 run osmo-hlr_10.42.42.2(pid=8845): stdout: | (launched: 2022-12-09_07:45:51.638757) 07:45:55.109167 run osmo-hlr_10.42.42.2(pid=8845): stderr: | 20221209074551835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074551835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074551835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074551835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074551835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074551835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074551850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074551860 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074551860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074551860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:55.160934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8838): Terminating (SIGTERM) 07:45:55.202614 run iperf3-srv_10.42.42.10(pid=8839): Terminating (SIGTERM) 07:45:55.244335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8840): Terminating (SIGTERM) 07:45:55.285955 run iperf3-srv_10.42.42.10(pid=8841): Terminating (SIGTERM) 07:45:55.327494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8844): Terminating (SIGTERM) 07:45:55.369088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8847): Terminating (SIGTERM) 07:45:55.410566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8850): Terminating (SIGTERM) 07:45:55.452380 --- ParallelTerminationStrategy: PID 8838 died... 07:45:55.472410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8838): Terminated: ok {rc=0} 07:45:55.518895 --- ParallelTerminationStrategy: PID 8839 died... 07:45:55.538392 run iperf3-srv_10.42.42.10(pid=8839): Terminated {rc=256} 07:45:55.584442 --- ParallelTerminationStrategy: PID 8840 died... 07:45:55.603967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8840): Terminated: ok {rc=0} 07:45:55.650085 --- ParallelTerminationStrategy: PID 8841 died... 07:45:55.669796 run iperf3-srv_10.42.42.10(pid=8841): Terminated {rc=256} 07:45:55.715670 --- ParallelTerminationStrategy: PID 8844 died... 07:45:55.735352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8844): Terminated: ok {rc=0} 07:45:55.781340 --- ParallelTerminationStrategy: PID 8847 died... 07:45:55.801063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8847): Terminated: ok {rc=0} 07:45:55.847021 --- ParallelTerminationStrategy: PID 8850 died... 07:45:55.866597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8850): Terminated: ok {rc=0} 07:45:55.954213 bus /gobi_0: Setting Powered False 07:45:57.054632 bus /gobi_0: Setting Powered False 07:45:58.172422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:45:59.318012 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.329926 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:45:59.401099 tst iperf3.py: using LAC 19977 07:45:59.520000 tst iperf3.py: using RAC 87 07:45:59.640482 tst iperf3.py: using CellId 19977 07:45:59.761126 tst iperf3.py: using BVCI 19978 07:45:59.871609 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.882843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.893658 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.904766 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.916026 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.927173 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.938491 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.949649 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:59.960615 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:00.074433 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:46:00.277391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:00.580094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8852): Launched 07:46:00.853726 run iperf3-srv_10.42.42.10(pid=8853): Launched 07:46:00.978631 tst iperf3.py:8: start network... 07:46:01.186155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:01.667288 run create_hlr_db(pid=8854): Launched 07:46:01.819427 bus /gobi_6: Setting Powered False 07:46:02.883498 run create_hlr_db(pid=8854): Terminated: ok {rc=0} 07:46:03.335653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8856): Launched 07:46:03.658621 run osmo-hlr_10.42.42.2(pid=8857): Launched 07:46:03.781343 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:04.341808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8859): Launched 07:46:04.663402 run osmo-stp_10.42.42.5(pid=8860): Launched 07:46:04.785607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:05.343042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8862): Launched 07:46:05.465759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:05.738624 run patchelf(pid=8863): Launched 07:46:05.916424 run osmo-stp_10.42.42.5(pid=8860): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8860)] 07:46:06.052347 run osmo-stp_10.42.42.5(pid=8860): stdout: | (launched: 2022-12-09_07:46:04.603853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:06.190593 run osmo-stp_10.42.42.5(pid=8860): stderr: | 20221209074604792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074604792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074604793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074604793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074604793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074604794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074604794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:06.327800 run osmo-stp_10.42.42.5(pid=8860): stdout: | (launched: 2022-12-09_07:46:04.603853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:06.459601 run osmo-stp_10.42.42.5(pid=8860): stderr: | 20221209074604792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074604792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074604793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074604793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074604793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074604794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074604794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:06.615825 run patchelf(pid=8863): Terminating (SIGINT) 07:46:06.795166 run patchelf(pid=8863): Terminated: ok {rc=0} 07:46:06.924463 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8860): Process ended prematurely: osmo-stp_10.42.42.5(pid=8860) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8860)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 07:46:06.934707 tst iperf3.py:8: Test FAILED (7.7 sec) 07:46:06.963235 run osmo-hlr_10.42.42.2(pid=8857): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8857)] 07:46:07.013360 run osmo-hlr_10.42.42.2(pid=8857): stdout: | (launched: 2022-12-09_07:46:03.599327) 07:46:07.065510 run osmo-hlr_10.42.42.2(pid=8857): stderr: | 20221209074603793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074603793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074603793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074603793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074603793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074603793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074603806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074603815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074603815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074603815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:07.117856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8852): Terminating (SIGTERM) 07:46:07.159776 run iperf3-srv_10.42.42.10(pid=8853): Terminating (SIGTERM) 07:46:07.201617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8856): Terminating (SIGTERM) 07:46:07.243413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8859): Terminating (SIGTERM) 07:46:07.285281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8862): Terminating (SIGTERM) 07:46:07.327466 --- ParallelTerminationStrategy: PID 8852 died... 07:46:07.347567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8852): Terminated: ok {rc=0} 07:46:07.393836 --- ParallelTerminationStrategy: PID 8853 died... 07:46:07.413410 run iperf3-srv_10.42.42.10(pid=8853): Terminated {rc=256} 07:46:07.459468 --- ParallelTerminationStrategy: PID 8856 died... 07:46:07.479127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8856): Terminated: ok {rc=0} 07:46:07.525082 --- ParallelTerminationStrategy: PID 8859 died... 07:46:07.544666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8859): Terminated: ok {rc=0} 07:46:07.590481 --- ParallelTerminationStrategy: PID 8862 died... 07:46:07.610114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8862): Terminated: ok {rc=0} 07:46:07.697384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:46:08.843764 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:08.855658 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:46:08.930501 tst iperf3m4.py: using LAC 19978 07:46:09.048430 tst iperf3m4.py: using RAC 88 07:46:09.165771 tst iperf3m4.py: using CellId 19978 07:46:09.287823 tst iperf3m4.py: using BVCI 19979 07:46:09.399528 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.410846 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.421675 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.433194 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.444683 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.456223 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.467841 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.479304 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:09.490950 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:09.612470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:09.731260 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:09.851892 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:09.970670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:46:10.174900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:10.479528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8865): Launched 07:46:10.742355 run iperf3-srv_10.42.42.10(pid=8866): Launched 07:46:10.855419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:46:11.057971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:11.361685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8867): Launched 07:46:11.623995 run iperf3-srv_10.42.42.10(pid=8868): Launched 07:46:11.736759 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:46:11.938884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:12.243091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8869): Launched 07:46:12.505885 run iperf3-srv_10.42.42.10(pid=8870): Launched 07:46:12.618448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:46:12.819357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:13.122048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Launched 07:46:13.383735 run iperf3-srv_10.42.42.10(pid=8872): Launched 07:46:13.495999 tst iperf3m4.py:8: start network... 07:46:13.698192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:14.166789 run create_hlr_db(pid=8873): Launched 07:46:14.281508 bus /gobi_6: Setting Powered False 07:46:15.341792 run create_hlr_db(pid=8873): Terminated: ok {rc=0} 07:46:15.782973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Launched 07:46:16.126801 run osmo-hlr_10.42.42.2(pid=8876): Launched 07:46:16.368270 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:17.076005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Launched 07:46:17.406672 run osmo-stp_10.42.42.5(pid=8879): Launched 07:46:17.529294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:18.085733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8881): Launched 07:46:18.208661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:18.481025 run patchelf(pid=8882): Launched 07:46:18.659029 run osmo-stp_10.42.42.5(pid=8879): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] 07:46:18.795013 run osmo-stp_10.42.42.5(pid=8879): stdout: | (launched: 2022-12-09_07:46:17.346991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:18.932227 run osmo-stp_10.42.42.5(pid=8879): stderr: | 20221209074617535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074617535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074617536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074617536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074617537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074617537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074617537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:19.069727 run osmo-stp_10.42.42.5(pid=8879): stdout: | (launched: 2022-12-09_07:46:17.346991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:19.202701 run osmo-stp_10.42.42.5(pid=8879): stderr: | 20221209074617535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074617535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074617536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074617536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074617537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074617537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074617537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:19.359170 run patchelf(pid=8882): Terminating (SIGINT) 07:46:19.538494 run patchelf(pid=8882): Terminated: ok {rc=0} 07:46:19.667702 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8879): Process ended prematurely: osmo-stp_10.42.42.5(pid=8879) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:46:19.678270 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:46:19.707076 run osmo-hlr_10.42.42.2(pid=8876): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8876)] 07:46:19.756647 run osmo-hlr_10.42.42.2(pid=8876): stdout: | (launched: 2022-12-09_07:46:16.065606) 07:46:19.808088 run osmo-hlr_10.42.42.2(pid=8876): stderr: | 20221209074616369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074616369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074616369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074616369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074616370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074616370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074616381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074616390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074616390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074616390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:19.859690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8865): Terminating (SIGTERM) 07:46:19.901559 run iperf3-srv_10.42.42.10(pid=8866): Terminating (SIGTERM) 07:46:19.943517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8867): Terminating (SIGTERM) 07:46:19.985516 run iperf3-srv_10.42.42.10(pid=8868): Terminating (SIGTERM) 07:46:20.027162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8869): Terminating (SIGTERM) 07:46:20.068882 run iperf3-srv_10.42.42.10(pid=8870): Terminating (SIGTERM) 07:46:20.112328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Terminating (SIGTERM) 07:46:20.154505 run iperf3-srv_10.42.42.10(pid=8872): Terminating (SIGTERM) 07:46:20.196166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Terminating (SIGTERM) 07:46:20.238086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Terminating (SIGTERM) 07:46:20.279542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8881): Terminating (SIGTERM) 07:46:20.321369 --- ParallelTerminationStrategy: PID 8865 died... 07:46:20.341453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8865): Terminated: ok {rc=0} 07:46:20.388154 --- ParallelTerminationStrategy: PID 8866 died... 07:46:20.407981 run iperf3-srv_10.42.42.10(pid=8866): Terminated {rc=256} 07:46:20.453768 --- ParallelTerminationStrategy: PID 8867 died... 07:46:20.473809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8867): Terminated: ok {rc=0} 07:46:20.519806 --- ParallelTerminationStrategy: PID 8868 died... 07:46:20.539410 run iperf3-srv_10.42.42.10(pid=8868): Terminated {rc=256} 07:46:20.585338 --- ParallelTerminationStrategy: PID 8869 died... 07:46:20.605015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8869): Terminated: ok {rc=0} 07:46:20.651371 --- ParallelTerminationStrategy: PID 8870 died... 07:46:20.671094 run iperf3-srv_10.42.42.10(pid=8870): Terminated {rc=256} 07:46:20.717055 --- ParallelTerminationStrategy: PID 8871 died... 07:46:20.736607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Terminated: ok {rc=0} 07:46:20.782645 --- ParallelTerminationStrategy: PID 8872 died... 07:46:20.802363 run iperf3-srv_10.42.42.10(pid=8872): Terminated {rc=256} 07:46:20.848080 --- ParallelTerminationStrategy: PID 8875 died... 07:46:20.867799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Terminated: ok {rc=0} 07:46:20.914097 --- ParallelTerminationStrategy: PID 8878 died... 07:46:20.933732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Terminated: ok {rc=0} 07:46:20.979615 --- ParallelTerminationStrategy: PID 8881 died... 07:46:20.999302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8881): Terminated: ok {rc=0} 07:46:21.086721 bus /gobi_4: Setting Powered False 07:46:22.183876 bus /gobi_4: Setting Powered False 07:46:23.299530 bus /gobi_1: Setting Powered False 07:46:24.397806 bus /gobi_1: Setting Powered False 07:46:25.513528 bus /gobi_0: Setting Powered False 07:46:26.612437 bus /gobi_0: Setting Powered False 07:46:27.729108 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:46:28.831399 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:28.843815 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:46:28.917815 tst ping.py: using LAC 19979 07:46:29.042931 tst ping.py: using RAC 89 07:46:29.169665 tst ping.py: using CellId 19979 07:46:29.294260 tst ping.py: using BVCI 19980 07:46:29.409143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.420571 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.431872 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.443205 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.454471 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.465723 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.477136 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:29.488459 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:29.608540 tst ping.py:19: start network... 07:46:29.819787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:30.311333 run create_hlr_db(pid=8883): Launched 07:46:30.440067 bus /gobi_6: Setting Powered False 07:46:31.498675 run create_hlr_db(pid=8883): Terminated: ok {rc=0} 07:46:31.974018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8885): Launched 07:46:32.302040 run osmo-hlr_10.42.42.2(pid=8886): Launched 07:46:32.422381 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:32.970904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8888): Launched 07:46:33.288851 run osmo-stp_10.42.42.5(pid=8889): Launched 07:46:33.408506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:33.955093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8891): Launched 07:46:34.075580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:34.345070 run patchelf(pid=8892): Launched 07:46:34.521157 run osmo-stp_10.42.42.5(pid=8889): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8889)] 07:46:34.655137 run osmo-stp_10.42.42.5(pid=8889): stdout: | (launched: 2022-12-09_07:46:33.229878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:34.790585 run osmo-stp_10.42.42.5(pid=8889): stderr: | 20221209074633416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074633416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074633417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074633417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074633418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074633418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074633418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:34.926089 run osmo-stp_10.42.42.5(pid=8889): stdout: | (launched: 2022-12-09_07:46:33.229878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:35.056685 run osmo-stp_10.42.42.5(pid=8889): stderr: | 20221209074633416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074633416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074633417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074633417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074633418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074633418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074633418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:35.211072 run patchelf(pid=8892): Terminating (SIGINT) 07:46:35.387847 run patchelf(pid=8892): Terminated: ok {rc=0} 07:46:35.514985 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8889): Process ended prematurely: osmo-stp_10.42.42.5(pid=8889) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8889)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 07:46:35.524634 tst ping.py:22: Test FAILED (6.7 sec) 07:46:35.552920 run osmo-hlr_10.42.42.2(pid=8886): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8886)] 07:46:35.603137 run osmo-hlr_10.42.42.2(pid=8886): stdout: | (launched: 2022-12-09_07:46:32.243378) 07:46:35.655042 run osmo-hlr_10.42.42.2(pid=8886): stderr: | 20221209074632438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074632438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074632438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074632438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074632438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074632438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074632450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074632458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074632459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074632459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:35.707271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8885): Terminating (SIGTERM) 07:46:35.749185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8888): Terminating (SIGTERM) 07:46:35.791027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8891): Terminating (SIGTERM) 07:46:35.833083 --- ParallelTerminationStrategy: PID 8885 died... 07:46:35.853290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8885): Terminated: ok {rc=0} 07:46:35.899819 --- ParallelTerminationStrategy: PID 8888 died... 07:46:35.919437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8888): Terminated: ok {rc=0} 07:46:35.965812 --- ParallelTerminationStrategy: PID 8891 died... 07:46:35.985720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8891): Terminated: ok {rc=0} 07:46:36.074189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:46:37.160484 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.172939 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:46:37.246902 tst ping_idle_ping.py: using LAC 19980 07:46:37.373417 tst ping_idle_ping.py: using RAC 90 07:46:37.497473 tst ping_idle_ping.py: using CellId 19980 07:46:37.621391 tst ping_idle_ping.py: using BVCI 19981 07:46:37.736608 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.748162 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.759615 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.770964 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.782290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.793623 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.805035 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:46:37.816374 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:46:37.932392 tst ping_idle_ping.py:24: start network... 07:46:38.147047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:38.645620 run create_hlr_db(pid=8893): Launched 07:46:38.776522 bus /gobi_6: Setting Powered False 07:46:39.840597 run create_hlr_db(pid=8893): Terminated: ok {rc=0} 07:46:40.267403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8895): Launched 07:46:40.566402 run osmo-hlr_10.42.42.2(pid=8896): Launched 07:46:40.680223 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:41.191556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8898): Launched 07:46:41.488152 run osmo-stp_10.42.42.5(pid=8899): Launched 07:46:41.601441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:42.115698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8901): Launched 07:46:42.228311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:42.479357 run patchelf(pid=8902): Launched 07:46:42.644349 run osmo-stp_10.42.42.5(pid=8899): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8899)] 07:46:42.770625 run osmo-stp_10.42.42.5(pid=8899): stdout: | (launched: 2022-12-09_07:46:41.432825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:42.898397 run osmo-stp_10.42.42.5(pid=8899): stderr: | 20221209074641597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074641598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074641598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074641598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074641599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074641599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074641599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:43.025801 run osmo-stp_10.42.42.5(pid=8899): stdout: | (launched: 2022-12-09_07:46:41.432825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:43.148215 run osmo-stp_10.42.42.5(pid=8899): stderr: | 20221209074641597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074641598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074641598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074641598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074641599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074641599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074641599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:43.292928 run patchelf(pid=8902): Terminating (SIGINT) 07:46:43.459124 run patchelf(pid=8902): Terminated: ok {rc=0} 07:46:43.578562 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8899): Process ended prematurely: osmo-stp_10.42.42.5(pid=8899) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8899)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:46:43.587644 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:46:43.615097 run osmo-hlr_10.42.42.2(pid=8896): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8896)] 07:46:43.663258 run osmo-hlr_10.42.42.2(pid=8896): stdout: | (launched: 2022-12-09_07:46:40.510578) 07:46:43.713441 run osmo-hlr_10.42.42.2(pid=8896): stderr: | 20221209074640682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074640682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074640682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074640682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074640682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074640682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074640694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074640703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074640704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074640704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:43.763401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8895): Terminating (SIGTERM) 07:46:43.803613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8898): Terminating (SIGTERM) 07:46:43.843659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8901): Terminating (SIGTERM) 07:46:43.884081 --- ParallelTerminationStrategy: PID 8895 died... 07:46:43.903439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8895): Terminated: ok {rc=0} 07:46:43.948368 --- ParallelTerminationStrategy: PID 8898 died... 07:46:43.967387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8898): Terminated: ok {rc=0} 07:46:44.011963 --- ParallelTerminationStrategy: PID 8901 died... 07:46:44.030814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8901): Terminated: ok {rc=0} 07:46:44.115592 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:46:45.419954 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:45.425967 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:46:45.460282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:46:45.499268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:46:45.585975 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:46:45.619305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:46:45.658541 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:46:46.253340 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:46:46.319909 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:46.334755 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:46:46.416909 tst cs_paging_gprs_active.py: using LAC 19981 07:46:46.572708 tst cs_paging_gprs_active.py: using RAC 91 07:46:46.732489 tst cs_paging_gprs_active.py: using CellId 19981 07:46:46.889403 tst cs_paging_gprs_active.py: using BVCI 19982 07:46:47.001629 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.013154 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.024545 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.036502 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.048072 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.059617 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.071539 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.083049 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:47.095013 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:46:47.214656 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:46:47.342711 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:46:47.546842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:47.850805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8907): Launched 07:46:48.114051 run iperf3-srv_10.42.42.10(pid=8908): Launched 07:46:48.227169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:46:48.429982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:48.734133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8909): Launched 07:46:48.997054 run iperf3-srv_10.42.42.10(pid=8910): Launched 07:46:49.110314 tst cs_paging_gprs_active.py:38: start network... 07:46:49.312215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:49.781531 run create_hlr_db(pid=8911): Launched 07:46:49.897194 bus /gobi_6: Setting Powered False 07:46:50.957836 run create_hlr_db(pid=8911): Terminated: ok {rc=0} 07:46:51.378779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8913): Launched 07:46:51.681948 run osmo-hlr_10.42.42.2(pid=8914): Launched 07:46:51.796694 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:52.329093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8916): Launched 07:46:52.632095 run osmo-stp_10.42.42.5(pid=8917): Launched 07:46:52.747306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:53.269471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8919): Launched 07:46:53.384757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:53.639880 run patchelf(pid=8920): Launched 07:46:53.808642 run osmo-stp_10.42.42.5(pid=8917): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8917)] 07:46:53.936614 run osmo-stp_10.42.42.5(pid=8917): stdout: | (launched: 2022-12-09_07:46:52.575973) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:54.065946 run osmo-stp_10.42.42.5(pid=8917): stderr: | 20221209074652742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074652743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074652743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074652743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074652744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074652744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074652744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:54.195968 run osmo-stp_10.42.42.5(pid=8917): stdout: | (launched: 2022-12-09_07:46:52.575973) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:54.319865 run osmo-stp_10.42.42.5(pid=8917): stderr: | 20221209074652742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074652743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074652743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074652743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074652744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074652744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074652744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:54.466880 run patchelf(pid=8920): Terminating (SIGINT) 07:46:54.635044 run patchelf(pid=8920): Terminated: ok {rc=0} 07:46:54.756630 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8917): Process ended prematurely: osmo-stp_10.42.42.5(pid=8917) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8917)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:46:54.766285 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:46:54.793517 run osmo-hlr_10.42.42.2(pid=8914): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8914)] 07:46:54.841766 run osmo-hlr_10.42.42.2(pid=8914): stdout: | (launched: 2022-12-09_07:46:51.625669) 07:46:54.891242 run osmo-hlr_10.42.42.2(pid=8914): stderr: | 20221209074651797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074651797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074651797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074651797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074651797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074651797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074651814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074651823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074651824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074651824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:54.941092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8907): Terminating (SIGTERM) 07:46:54.980614 run iperf3-srv_10.42.42.10(pid=8908): Terminating (SIGTERM) 07:46:55.020184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8909): Terminating (SIGTERM) 07:46:55.059864 run iperf3-srv_10.42.42.10(pid=8910): Terminating (SIGTERM) 07:46:55.099331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8913): Terminating (SIGTERM) 07:46:55.138707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8916): Terminating (SIGTERM) 07:46:55.178313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8919): Terminating (SIGTERM) 07:46:55.218098 --- ParallelTerminationStrategy: PID 8907 died... 07:46:55.237151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8907): Terminated: ok {rc=0} 07:46:55.281331 --- ParallelTerminationStrategy: PID 8908 died... 07:46:55.299731 run iperf3-srv_10.42.42.10(pid=8908): Terminated {rc=256} 07:46:55.343885 --- ParallelTerminationStrategy: PID 8909 died... 07:46:55.362594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8909): Terminated: ok {rc=0} 07:46:55.407084 --- ParallelTerminationStrategy: PID 8910 died... 07:46:55.425634 run iperf3-srv_10.42.42.10(pid=8910): Terminated {rc=256} 07:46:55.469376 --- ParallelTerminationStrategy: PID 8913 died... 07:46:55.487746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8913): Terminated: ok {rc=0} 07:46:55.531460 --- ParallelTerminationStrategy: PID 8916 died... 07:46:55.550013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8916): Terminated: ok {rc=0} 07:46:55.593825 --- ParallelTerminationStrategy: PID 8919 died... 07:46:55.612312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8919): Terminated: ok {rc=0} 07:46:55.696466 bus /gobi_0: Setting Powered False 07:46:56.794134 bus /gobi_0: Setting Powered False 07:46:57.909621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:46:59.057126 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.069203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:46:59.142812 tst iperf3.py: using LAC 19982 07:46:59.269408 tst iperf3.py: using RAC 92 07:46:59.388100 tst iperf3.py: using CellId 19982 07:46:59.516347 tst iperf3.py: using BVCI 19983 07:46:59.635603 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.647060 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.658263 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.670157 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.681897 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.693688 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.705572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.717146 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:59.728796 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:46:59.849495 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:47:00.070353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:00.396195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8922): Launched 07:47:00.677365 run iperf3-srv_10.42.42.10(pid=8923): Launched 07:47:00.797704 tst iperf3.py:8: start network... 07:47:01.032444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:01.572304 run create_hlr_db(pid=8924): Launched 07:47:01.710675 bus /gobi_6: Setting Powered False 07:47:02.771204 run create_hlr_db(pid=8924): Terminated: ok {rc=0} 07:47:03.193184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8926): Launched 07:47:03.497736 run osmo-hlr_10.42.42.2(pid=8927): Launched 07:47:03.612797 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:04.147982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8929): Launched 07:47:04.449851 run osmo-stp_10.42.42.5(pid=8930): Launched 07:47:04.565201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:05.084862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8932): Launched 07:47:05.199806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:05.454794 run patchelf(pid=8933): Launched 07:47:05.622008 run osmo-stp_10.42.42.5(pid=8930): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8930)] 07:47:05.749346 run osmo-stp_10.42.42.5(pid=8930): stdout: | (launched: 2022-12-09_07:47:04.393275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:05.878645 run osmo-stp_10.42.42.5(pid=8930): stderr: | 20221209074704561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074704561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074704562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074704562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074704563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074704563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074704563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:06.007440 run osmo-stp_10.42.42.5(pid=8930): stdout: | (launched: 2022-12-09_07:47:04.393275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:06.130862 run osmo-stp_10.42.42.5(pid=8930): stderr: | 20221209074704561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074704561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074704562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074704562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074704563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074704563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074704563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:06.277123 run patchelf(pid=8933): Terminating (SIGINT) 07:47:06.444726 run patchelf(pid=8933): Terminated: ok {rc=0} 07:47:06.565307 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8930): Process ended prematurely: osmo-stp_10.42.42.5(pid=8930) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8930)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 07:47:06.574636 tst iperf3.py:8: Test FAILED (7.6 sec) 07:47:06.602257 run osmo-hlr_10.42.42.2(pid=8927): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8927)] 07:47:06.649917 run osmo-hlr_10.42.42.2(pid=8927): stdout: | (launched: 2022-12-09_07:47:03.440768) 07:47:06.699499 run osmo-hlr_10.42.42.2(pid=8927): stderr: | 20221209074703617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074703618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074703618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074703618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074703618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074703618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074703641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074703653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074703653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074703654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:06.749365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8922): Terminating (SIGTERM) 07:47:06.789204 run iperf3-srv_10.42.42.10(pid=8923): Terminating (SIGTERM) 07:47:06.829019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8926): Terminating (SIGTERM) 07:47:06.868743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8929): Terminating (SIGTERM) 07:47:06.908308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8932): Terminating (SIGTERM) 07:47:06.948454 --- ParallelTerminationStrategy: PID 8922 died... 07:47:06.967493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8922): Terminated: ok {rc=0} 07:47:07.011884 --- ParallelTerminationStrategy: PID 8923 died... 07:47:07.030468 run iperf3-srv_10.42.42.10(pid=8923): Terminated {rc=256} 07:47:07.074842 --- ParallelTerminationStrategy: PID 8926 died... 07:47:07.093549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8926): Terminated: ok {rc=0} 07:47:07.137635 --- ParallelTerminationStrategy: PID 8929 died... 07:47:07.155896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8929): Terminated: ok {rc=0} 07:47:07.200536 --- ParallelTerminationStrategy: PID 8932 died... 07:47:07.219369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8932): Terminated: ok {rc=0} 07:47:07.305633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:47:08.453083 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:08.464914 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:47:08.537976 tst iperf3m4.py: using LAC 19983 07:47:08.657316 tst iperf3m4.py: using RAC 93 07:47:08.785326 tst iperf3m4.py: using CellId 19983 07:47:08.916294 tst iperf3m4.py: using BVCI 19984 07:47:09.028797 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.039962 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.050951 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.062154 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.073396 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.084544 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.095884 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.107054 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:09.118187 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:47:09.238978 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:47:09.360687 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:47:09.481526 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:47:09.600062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:47:09.803402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:10.107871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8934): Launched 07:47:10.371520 run iperf3-srv_10.42.42.10(pid=8935): Launched 07:47:10.484794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:47:10.686801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:10.991014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8936): Launched 07:47:11.254461 run iperf3-srv_10.42.42.10(pid=8937): Launched 07:47:11.367878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:47:11.570807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:11.874988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8938): Launched 07:47:12.138616 run iperf3-srv_10.42.42.10(pid=8939): Launched 07:47:12.251381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:47:12.453585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:12.757023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Launched 07:47:13.019837 run iperf3-srv_10.42.42.10(pid=8941): Launched 07:47:13.133211 tst iperf3m4.py:8: start network... 07:47:13.335462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:13.802976 run create_hlr_db(pid=8942): Launched 07:47:13.916751 bus /gobi_6: Setting Powered False 07:47:14.975915 run create_hlr_db(pid=8942): Terminated: ok {rc=0} 07:47:15.398605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8944): Launched 07:47:15.701665 run osmo-hlr_10.42.42.2(pid=8945): Launched 07:47:15.815917 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:16.485917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8947): Launched 07:47:16.820446 run osmo-stp_10.42.42.5(pid=8948): Launched 07:47:17.071374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:17.718251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8950): Launched 07:47:17.842768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:18.117243 run patchelf(pid=8951): Launched 07:47:18.296566 run osmo-stp_10.42.42.5(pid=8948): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8948)] 07:47:18.432684 run osmo-stp_10.42.42.5(pid=8948): stdout: | (launched: 2022-12-09_07:47:16.748162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:18.570377 run osmo-stp_10.42.42.5(pid=8948): stderr: | 20221209074717002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074717002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074717002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074717003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074717003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074717003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074717003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:18.708011 run osmo-stp_10.42.42.5(pid=8948): stdout: | (launched: 2022-12-09_07:47:16.748162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:18.839914 run osmo-stp_10.42.42.5(pid=8948): stderr: | 20221209074717002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074717002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074717002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074717003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074717003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074717003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074717003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:18.996158 run patchelf(pid=8951): Terminating (SIGINT) 07:47:19.176384 run patchelf(pid=8951): Terminated: ok {rc=0} 07:47:19.306282 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8948): Process ended prematurely: osmo-stp_10.42.42.5(pid=8948) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8948)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:47:19.316570 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:47:19.345760 run osmo-hlr_10.42.42.2(pid=8945): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8945)] 07:47:19.395971 run osmo-hlr_10.42.42.2(pid=8945): stdout: | (launched: 2022-12-09_07:47:15.645124) 07:47:19.447968 run osmo-hlr_10.42.42.2(pid=8945): stderr: | 20221209074715819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074715819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074715819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074715819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074715819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074715819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074715847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074715863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074715864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074715864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:19.500384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8934): Terminating (SIGTERM) 07:47:19.542324 run iperf3-srv_10.42.42.10(pid=8935): Terminating (SIGTERM) 07:47:19.584064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8936): Terminating (SIGTERM) 07:47:19.626388 run iperf3-srv_10.42.42.10(pid=8937): Terminating (SIGTERM) 07:47:19.667932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8938): Terminating (SIGTERM) 07:47:19.709731 run iperf3-srv_10.42.42.10(pid=8939): Terminating (SIGTERM) 07:47:19.751527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Terminating (SIGTERM) 07:47:19.793172 run iperf3-srv_10.42.42.10(pid=8941): Terminating (SIGTERM) 07:47:19.834535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8944): Terminating (SIGTERM) 07:47:19.876190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8947): Terminating (SIGTERM) 07:47:19.917830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8950): Terminating (SIGTERM) 07:47:19.959621 --- ParallelTerminationStrategy: PID 8934 died... 07:47:19.979744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8934): Terminated: ok {rc=0} 07:47:20.025974 --- ParallelTerminationStrategy: PID 8935 died... 07:47:20.045475 run iperf3-srv_10.42.42.10(pid=8935): Terminated {rc=256} 07:47:20.091169 --- ParallelTerminationStrategy: PID 8936 died... 07:47:20.110713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8936): Terminated: ok {rc=0} 07:47:20.157138 --- ParallelTerminationStrategy: PID 8937 died... 07:47:20.176574 run iperf3-srv_10.42.42.10(pid=8937): Terminated {rc=256} 07:47:20.222503 --- ParallelTerminationStrategy: PID 8938 died... 07:47:20.241976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8938): Terminated: ok {rc=0} 07:47:20.287673 --- ParallelTerminationStrategy: PID 8939 died... 07:47:20.307220 run iperf3-srv_10.42.42.10(pid=8939): Terminated {rc=256} 07:47:20.353187 --- ParallelTerminationStrategy: PID 8940 died... 07:47:20.372703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Terminated: ok {rc=0} 07:47:20.418789 --- ParallelTerminationStrategy: PID 8941 died... 07:47:20.438337 run iperf3-srv_10.42.42.10(pid=8941): Terminated {rc=256} 07:47:20.484103 --- ParallelTerminationStrategy: PID 8944 died... 07:47:20.503659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8944): Terminated: ok {rc=0} 07:47:20.549580 --- ParallelTerminationStrategy: PID 8947 died... 07:47:20.568928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8947): Terminated: ok {rc=0} 07:47:20.614958 --- ParallelTerminationStrategy: PID 8950 died... 07:47:20.634538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8950): Terminated: ok {rc=0} 07:47:20.721998 bus /gobi_4: Setting Powered False 07:47:21.821664 bus /gobi_4: Setting Powered False 07:47:22.937542 bus /gobi_1: Setting Powered False 07:47:24.036347 bus /gobi_1: Setting Powered False 07:47:25.150775 bus /gobi_0: Setting Powered False 07:47:26.249888 bus /gobi_0: Setting Powered False 07:47:27.365815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:47:28.468742 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:28.481410 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:47:28.555426 tst ping.py: using LAC 19984 07:47:28.682289 tst ping.py: using RAC 94 07:47:28.813243 tst ping.py: using CellId 19984 07:47:28.941806 tst ping.py: using BVCI 19985 07:47:29.052176 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.063528 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.074666 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.086018 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.097191 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.108098 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.119438 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:29.130523 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:47:29.249385 tst ping.py:19: start network... 07:47:29.464384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:29.960619 run create_hlr_db(pid=8952): Launched 07:47:30.092451 bus /gobi_6: Setting Powered False 07:47:31.152833 run create_hlr_db(pid=8952): Terminated: ok {rc=0} 07:47:31.584986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8954): Launched 07:47:31.905253 run osmo-hlr_10.42.42.2(pid=8955): Launched 07:47:32.145234 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:32.714184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8957): Launched 07:47:33.034334 run osmo-stp_10.42.42.5(pid=8958): Launched 07:47:33.157917 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:33.710586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8960): Launched 07:47:33.833491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:34.103784 run patchelf(pid=8961): Launched 07:47:34.283148 run osmo-stp_10.42.42.5(pid=8958): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8958)] 07:47:34.418010 run osmo-stp_10.42.42.5(pid=8958): stdout: | (launched: 2022-12-09_07:47:32.974840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:34.554248 run osmo-stp_10.42.42.5(pid=8958): stderr: | 20221209074733167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074733168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074733168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074733168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074733169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074733169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074733169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:34.690257 run osmo-stp_10.42.42.5(pid=8958): stdout: | (launched: 2022-12-09_07:47:32.974840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:34.820927 run osmo-stp_10.42.42.5(pid=8958): stderr: | 20221209074733167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074733168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074733168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074733168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074733169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074733169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074733169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:34.975650 run patchelf(pid=8961): Terminating (SIGINT) 07:47:35.154175 run patchelf(pid=8961): Terminated: ok {rc=0} 07:47:35.282336 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8958): Process ended prematurely: osmo-stp_10.42.42.5(pid=8958) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8958)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 07:47:35.292051 tst ping.py:22: Test FAILED (6.8 sec) 07:47:35.320521 run osmo-hlr_10.42.42.2(pid=8955): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8955)] 07:47:35.370954 run osmo-hlr_10.42.42.2(pid=8955): stdout: | (launched: 2022-12-09_07:47:31.848260) 07:47:35.423020 run osmo-hlr_10.42.42.2(pid=8955): stderr: | 20221209074732097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074732098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074732098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074732098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074732098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074732098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074732119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074732139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074732140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074732140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:35.475474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8954): Terminating (SIGTERM) 07:47:35.517452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8957): Terminating (SIGTERM) 07:47:35.559444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8960): Terminating (SIGTERM) 07:47:35.601816 --- ParallelTerminationStrategy: PID 8954 died... 07:47:35.622058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8954): Terminated: ok {rc=0} 07:47:35.668635 --- ParallelTerminationStrategy: PID 8957 died... 07:47:35.688458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8957): Terminated: ok {rc=0} 07:47:35.734896 --- ParallelTerminationStrategy: PID 8960 died... 07:47:35.755433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8960): Terminated: ok {rc=0} 07:47:35.847997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:47:36.936571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:36.948279 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:47:37.020677 tst ping_idle_ping.py: using LAC 19985 07:47:37.148487 tst ping_idle_ping.py: using RAC 95 07:47:37.274359 tst ping_idle_ping.py: using CellId 19985 07:47:37.401428 tst ping_idle_ping.py: using BVCI 19986 07:47:37.517874 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.529711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.541259 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.553047 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.564618 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.576417 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.588281 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:47:37.599975 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:47:37.717633 tst ping_idle_ping.py:24: start network... 07:47:37.918157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:38.384254 run create_hlr_db(pid=8963): Launched 07:47:38.498661 bus /gobi_6: Setting Powered False 07:47:39.562008 run create_hlr_db(pid=8963): Terminated: ok {rc=0} 07:47:39.991589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8965): Launched 07:47:40.290907 run osmo-hlr_10.42.42.2(pid=8966): Launched 07:47:40.405858 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:40.932064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8968): Launched 07:47:41.229959 run osmo-stp_10.42.42.5(pid=8969): Launched 07:47:41.345681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:41.860372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8971): Launched 07:47:41.974250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:42.227017 run patchelf(pid=8972): Launched 07:47:42.393718 run osmo-stp_10.42.42.5(pid=8969): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8969)] 07:47:42.519475 run osmo-stp_10.42.42.5(pid=8969): stdout: | (launched: 2022-12-09_07:47:41.174333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:42.646735 run osmo-stp_10.42.42.5(pid=8969): stderr: | 20221209074741344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074741344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074741344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074741344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074741345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074741345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074741345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:42.773928 run osmo-stp_10.42.42.5(pid=8969): stdout: | (launched: 2022-12-09_07:47:41.174333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:42.895671 run osmo-stp_10.42.42.5(pid=8969): stderr: | 20221209074741344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074741344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074741344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074741344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074741345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074741345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074741345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:43.040020 run patchelf(pid=8972): Terminating (SIGINT) 07:47:43.206283 run patchelf(pid=8972): Terminated: ok {rc=0} 07:47:43.325995 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8969): Process ended prematurely: osmo-stp_10.42.42.5(pid=8969) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8969)] [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:47:43.334902 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:47:43.362205 run osmo-hlr_10.42.42.2(pid=8966): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8966)] 07:47:43.410740 run osmo-hlr_10.42.42.2(pid=8966): stdout: | (launched: 2022-12-09_07:47:40.235375) 07:47:43.460797 run osmo-hlr_10.42.42.2(pid=8966): stderr: | 20221209074740410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074740410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074740410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074740410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074740410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074740410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074740422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074740431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074740431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074740431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:43.511085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8965): Terminating (SIGTERM) 07:47:43.551095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8968): Terminating (SIGTERM) 07:47:43.591229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8971): Terminating (SIGTERM) 07:47:43.631419 --- ParallelTerminationStrategy: PID 8965 died... 07:47:43.650570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8965): Terminated: ok {rc=0} 07:47:43.695414 --- ParallelTerminationStrategy: PID 8968 died... 07:47:43.714166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8968): Terminated: ok {rc=0} 07:47:43.758973 --- ParallelTerminationStrategy: PID 8971 died... 07:47:43.777646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8971): Terminated: ok {rc=0} 07:47:43.863757 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:47:45.168298 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:45.175391 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:47:45.210359 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:47:45.245250 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:47:45.298702 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:47:45.332070 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:47:45.366908 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:47:45.961496 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:47:45.967145 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:45.978946 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:47:46.052826 tst switch_tch_pdch.py: using LAC 19986 07:47:46.180307 tst switch_tch_pdch.py: using RAC 96 07:47:46.302012 tst switch_tch_pdch.py: using CellId 19986 07:47:46.430584 tst switch_tch_pdch.py: using BVCI 19987 07:47:46.581423 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.594360 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.607809 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.620253 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.633508 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.648551 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.660927 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:47:46.673982 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:47:46.798864 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:47:46.957535 tst switch_tch_pdch.py:51: start network... 07:47:47.177480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:47.673974 run create_hlr_db(pid=8976): Launched 07:47:47.804060 bus /gobi_6: Setting Powered False 07:47:48.866164 run create_hlr_db(pid=8976): Terminated: ok {rc=0} 07:47:49.290916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8978): Launched 07:47:49.588923 run osmo-hlr_10.42.42.2(pid=8979): Launched 07:47:49.702798 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:50.226694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8981): Launched 07:47:50.523465 run osmo-stp_10.42.42.5(pid=8982): Launched 07:47:50.637304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:51.150152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8984): Launched 07:47:51.263427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:51.514497 run patchelf(pid=8985): Launched 07:47:51.681247 run osmo-stp_10.42.42.5(pid=8982): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8982)] 07:47:51.806526 run osmo-stp_10.42.42.5(pid=8982): stdout: | (launched: 2022-12-09_07:47:50.468188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:51.934027 run osmo-stp_10.42.42.5(pid=8982): stderr: | 20221209074750638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074750638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074750639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074750639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074750640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074750640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074750640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:52.060588 run osmo-stp_10.42.42.5(pid=8982): stdout: | (launched: 2022-12-09_07:47:50.468188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:52.181981 run osmo-stp_10.42.42.5(pid=8982): stderr: | 20221209074750638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074750638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074750639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074750639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074750640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074750640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074750640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:52.325749 run patchelf(pid=8985): Terminating (SIGINT) 07:47:52.491166 run patchelf(pid=8985): Terminated: ok {rc=0} 07:47:52.610601 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8982): Process ended prematurely: osmo-stp_10.42.42.5(pid=8982) [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8982)] [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:47:52.619687 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 07:47:52.646498 run osmo-hlr_10.42.42.2(pid=8979): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8979)] 07:47:52.694541 run osmo-hlr_10.42.42.2(pid=8979): stdout: | (launched: 2022-12-09_07:47:49.533435) 07:47:52.744122 run osmo-hlr_10.42.42.2(pid=8979): stderr: | 20221209074749705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074749705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074749705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074749705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074749705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074749705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074749718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074749729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074749729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074749729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:52.793926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8978): Terminating (SIGTERM) 07:47:52.833658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8981): Terminating (SIGTERM) 07:47:52.873556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8984): Terminating (SIGTERM) 07:47:52.913353 --- ParallelTerminationStrategy: PID 8978 died... 07:47:52.932332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8978): Terminated: ok {rc=0} 07:47:52.976491 --- ParallelTerminationStrategy: PID 8981 died... 07:47:52.995095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8981): Terminated: ok {rc=0} 07:47:53.038980 --- ParallelTerminationStrategy: PID 8984 died... 07:47:53.057483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8984): Terminated: ok {rc=0} 07:47:53.142964 bus /gobi_0: Setting Powered False 07:47:54.242228 bus /gobi_0: Setting Powered False 07:47:55.358646 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:47:56.612589 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:56.618461 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:47:56.652315 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:47:56.687348 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:47:56.740583 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:47:56.774020 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:47:56.809214 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:47:57.364376 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:47:57.369712 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.380668 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:47:57.450142 tst switch_tch_pdch.py: using LAC 19987 07:47:57.566702 tst switch_tch_pdch.py: using RAC 97 07:47:57.684342 tst switch_tch_pdch.py: using CellId 19987 07:47:57.800513 tst switch_tch_pdch.py: using BVCI 19988 07:47:57.908189 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.919413 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.930196 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.941358 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.952317 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.963486 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.974807 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:47:57.986105 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:47:58.099757 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:47:58.215347 tst switch_tch_pdch.py:51: start network... 07:47:58.414180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:58.849955 run create_hlr_db(pid=8989): Launched 07:47:58.962263 bus /gobi_6: Setting Powered False 07:48:00.021274 run create_hlr_db(pid=8989): Terminated: ok {rc=0} 07:48:00.428242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8991): Launched 07:48:00.729672 run osmo-hlr_10.42.42.2(pid=8992): Launched 07:48:00.864036 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:01.467705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8994): Launched 07:48:01.803735 run osmo-stp_10.42.42.5(pid=8995): Launched 07:48:02.177461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:48:02.721796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8997): Launched 07:48:02.843342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:48:03.111118 run patchelf(pid=8998): Launched 07:48:03.288612 run osmo-stp_10.42.42.5(pid=8995): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8995)] 07:48:03.422445 run osmo-stp_10.42.42.5(pid=8995): stdout: | (launched: 2022-12-09_07:48:01.744783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:03.557770 run osmo-stp_10.42.42.5(pid=8995): stderr: | 20221209074802004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074802004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074802005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074802005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074802007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074802007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074802007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:03.693221 run osmo-stp_10.42.42.5(pid=8995): stdout: | (launched: 2022-12-09_07:48:01.744783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:03.823000 run osmo-stp_10.42.42.5(pid=8995): stderr: | 20221209074802004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074802004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074802005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074802005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074802007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074802007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074802007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:03.977401 run patchelf(pid=8998): Terminating (SIGINT) 07:48:04.154823 run patchelf(pid=8998): Terminated: ok {rc=0} 07:48:04.283022 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8995): Process ended prematurely: osmo-stp_10.42.42.5(pid=8995) [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8995)] [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:48:04.292652 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 07:48:04.321238 run osmo-hlr_10.42.42.2(pid=8992): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8992)] 07:48:04.371159 run osmo-hlr_10.42.42.2(pid=8992): stdout: | (launched: 2022-12-09_07:48:00.674580) 07:48:04.422432 run osmo-hlr_10.42.42.2(pid=8992): stderr: | 20221209074800848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074800848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074800848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074800848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074800848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074800848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074800872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074800889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074800890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074800890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:04.474418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8991): Terminating (SIGTERM) 07:48:04.515647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8994): Terminating (SIGTERM) 07:48:04.556905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8997): Terminating (SIGTERM) 07:48:04.598612 --- ParallelTerminationStrategy: PID 8991 died... 07:48:04.618416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8991): Terminated: ok {rc=0} 07:48:04.664460 --- ParallelTerminationStrategy: PID 8994 died... 07:48:04.683899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8994): Terminated: ok {rc=0} 07:48:04.729953 --- ParallelTerminationStrategy: PID 8997 died... 07:48:04.749435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8997): Terminated: ok {rc=0} 07:48:04.836265 bus /gobi_0: Setting Powered False 07:48:05.936375 bus /gobi_0: Setting Powered False 07:48:07.052334 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 07:48:08.312727 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:08.316897 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:48:08.347558 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 07:48:08.354595 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 07:48:08.406799 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:48:08.437300 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 07:48:08.444324 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 07:48:08.986577 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 07:48:08.991644 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 07:48:09.003150 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:48:09.048542 tst mo_mt_sms.py: using LAC 19988 07:48:09.170880 tst mo_mt_sms.py: using RAC 98 07:48:09.293199 tst mo_mt_sms.py: using CellId 19988 07:48:09.415640 tst mo_mt_sms.py: using BVCI 19989 07:48:09.529878 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:48:09.645434 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:48:09.759502 tst mo_mt_sms.py:9: start nitb and bts... 07:48:09.960267 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:48:10.568292 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9002): Launched 07:48:10.866260 run osmo-nitb_10.42.42.2(pid=9003): Launched 07:48:11.033841 run osmo-nitb_10.42.42.2(pid=9003): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9003)] 07:48:11.167549 run osmo-nitb_10.42.42.2(pid=9003): stdout: | (launched: 2022-12-09_07:48:10.810652) 07:48:11.302834 run osmo-nitb_10.42.42.2(pid=9003): stderr: | (launched: 2022-12-09_07:48:10.855005) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:48:11.437820 run osmo-nitb_10.42.42.2(pid=9003): stdout: | (launched: 2022-12-09_07:48:10.810652) 07:48:11.568031 run osmo-nitb_10.42.42.2(pid=9003): stderr: | (launched: 2022-12-09_07:48:10.855005) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9003): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9003) [trial-2356↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9003)] 07:48:11.981113 tst osmo-nitb_10.42.42.2(pid=9003): stdout: | (launched: 2022-12-09_07:48:10.810652) 07:48:12.100739 tst osmo-nitb_10.42.42.2(pid=9003): stderr: | (launched: 2022-12-09_07:48:10.855005) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:48:12.242177 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9003): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9003) [trial-2356↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9003)] [trial-2356↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 07:48:12.250685 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:48:12.257274 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9002): Terminating (SIGTERM) 07:48:12.467921 --- ParallelTerminationStrategy: PID 9002 died... 07:48:12.488450 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9002): Terminated: ok {rc=0} 07:48:12.575290 bus /sierra_3: Setting Powered False 07:48:13.675477 bus /sierra_3: Setting Powered False 07:48:14.794180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 07:48:16.019637 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:16.024358 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:48:16.060356 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:48:16.098031 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 07:48:16.162430 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:48:16.197414 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:48:16.226614 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 07:48:16.798429 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 07:48:16.807141 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:16.823115 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:48:16.882731 tst mo_mt_sms.py: using LAC 19989 07:48:17.044567 tst mo_mt_sms.py: using RAC 99 07:48:17.172467 tst mo_mt_sms.py: using CellId 19989 07:48:17.297324 tst mo_mt_sms.py: using BVCI 19990 07:48:17.408301 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:17.419306 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:17.430063 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:17.441611 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:17.452567 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:17.463262 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:48:17.585480 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:48:17.704930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:18.200666 run create_hlr_db(pid=9008): Launched 07:48:18.329927 bus /sierra_2: Setting Powered False 07:48:19.393216 run create_hlr_db(pid=9008): Terminated: ok {rc=0} 07:48:19.836016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9010): Launched 07:48:20.155483 run osmo-hlr_10.42.42.2(pid=9011): Launched 07:48:20.278107 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:20.831279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9013): Launched 07:48:21.149987 run osmo-stp_10.42.42.5(pid=9014): Launched 07:48:21.274475 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:21.853698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9016): Launched 07:48:22.172139 run osmo-msc_10.42.42.6(pid=9017): Launched 07:48:22.349380 run osmo-stp_10.42.42.5(pid=9014): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9014)] 07:48:22.483491 run osmo-stp_10.42.42.5(pid=9014): stdout: | (launched: 2022-12-09_07:48:21.091162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:22.618268 run osmo-stp_10.42.42.5(pid=9014): stderr: | 20221209074821282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074821282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074821282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074821283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074821283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074821283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074821283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:22.752553 run osmo-stp_10.42.42.5(pid=9014): stdout: | (launched: 2022-12-09_07:48:21.091162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:22.879386 run osmo-stp_10.42.42.5(pid=9014): stderr: | 20221209074821282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074821282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074821282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074821283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074821283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074821283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074821283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:23.030960 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9014): Process ended prematurely: osmo-stp_10.42.42.5(pid=9014) [trial-2356↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9014)] [trial-2356↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 07:48:23.040302 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 07:48:23.068373 run osmo-hlr_10.42.42.2(pid=9011): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9011)] 07:48:23.118704 run osmo-hlr_10.42.42.2(pid=9011): stdout: | (launched: 2022-12-09_07:48:20.096743) 07:48:23.171097 run osmo-hlr_10.42.42.2(pid=9011): stderr: | 20221209074820292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074820292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074820292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074820292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074820292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074820293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074820305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074820313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074820313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074820313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:23.243363 run osmo-msc_10.42.42.6(pid=9017): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9017)] 07:48:23.293803 run osmo-msc_10.42.42.6(pid=9017): stdout: | (launched: 2022-12-09_07:48:22.113128) 07:48:23.346046 run osmo-msc_10.42.42.6(pid=9017): stderr: | 20221209074822433 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074822433 DLGLOBAL DEBUG validating counter group 0x7ff1dbd09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074822433 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074822433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074822433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074822434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074822435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074822436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074822436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074822436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:23.398433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9010): Terminating (SIGTERM) 07:48:23.440504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9013): Terminating (SIGTERM) 07:48:23.482674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9016): Terminating (SIGTERM) 07:48:23.525361 --- ParallelTerminationStrategy: PID 9010 died... 07:48:23.545259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9010): Terminated: ok {rc=0} 07:48:23.591887 --- ParallelTerminationStrategy: PID 9013 died... 07:48:23.611699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9013): Terminated: ok {rc=0} 07:48:23.658297 --- ParallelTerminationStrategy: PID 9016 died... 07:48:23.678223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9016): Terminated: ok {rc=0} 07:48:23.766386 bus /sierra_3: Setting Powered False 07:48:24.864883 bus /sierra_3: Setting Powered False 07:48:25.980935 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 07:48:27.207272 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:27.211427 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:48:27.241420 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 07:48:27.248467 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 07:48:27.283392 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:48:27.313448 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 07:48:27.320316 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 07:48:27.841184 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 07:48:27.846406 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 07:48:27.857647 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:48:27.901878 tst assert_extension.py: using LAC 19990 07:48:28.020717 tst assert_extension.py: using RAC 100 07:48:28.137214 tst assert_extension.py: using CellId 19990 07:48:28.254947 tst assert_extension.py: using BVCI 19991 07:48:28.364662 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 07:48:28.478973 tst assert_extension.py:10: start nitb and bts... 07:48:28.677962 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:48:29.287861 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9022): Launched 07:48:29.585954 run osmo-nitb_10.42.42.2(pid=9023): Launched 07:48:29.752462 run osmo-nitb_10.42.42.2(pid=9023): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9023)] 07:48:29.885577 run osmo-nitb_10.42.42.2(pid=9023): stdout: | (launched: 2022-12-09_07:48:29.530301) 07:48:30.020405 run osmo-nitb_10.42.42.2(pid=9023): stderr: | (launched: 2022-12-09_07:48:29.574459) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:48:30.155311 run osmo-nitb_10.42.42.2(pid=9023): stdout: | (launched: 2022-12-09_07:48:29.530301) 07:48:30.285376 run osmo-nitb_10.42.42.2(pid=9023): stderr: | (launched: 2022-12-09_07:48:29.574459) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9023) [trial-2356↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9023)] 07:48:30.700582 tst osmo-nitb_10.42.42.2(pid=9023): stdout: | (launched: 2022-12-09_07:48:29.530301) 07:48:30.820174 tst osmo-nitb_10.42.42.2(pid=9023): stderr: | (launched: 2022-12-09_07:48:29.574459) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:48:30.964163 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9023) [trial-2356↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9023)] [trial-2356↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 07:48:30.973884 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:48:30.981514 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9022): Terminating (SIGTERM) 07:48:31.194478 --- ParallelTerminationStrategy: PID 9022 died... 07:48:31.217865 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9022): Terminated: ok {rc=0} 07:48:31.324854 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 07:48:32.510894 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:32.515133 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:48:32.546610 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:48:32.574478 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 07:48:32.611537 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:48:32.642337 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:48:32.670157 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 07:48:33.201363 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 07:48:33.207380 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:33.219085 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:48:33.264896 tst assert_extension.py: using LAC 19991 07:48:33.393331 tst assert_extension.py: using RAC 101 07:48:33.517520 tst assert_extension.py: using CellId 19991 07:48:33.636307 tst assert_extension.py: using BVCI 19992 07:48:33.744267 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:33.755349 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:33.766296 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:33.778016 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:33.789707 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:48:33.801516 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 07:48:33.919778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:34.382029 run create_hlr_db(pid=9027): Launched 07:48:34.495152 bus /sierra_2: Setting Powered False 07:48:35.554448 run create_hlr_db(pid=9027): Terminated: ok {rc=0} 07:48:35.969526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9029): Launched 07:48:36.267983 run osmo-hlr_10.42.42.2(pid=9030): Launched 07:48:36.382228 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:36.911274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9032): Launched 07:48:37.210018 run osmo-stp_10.42.42.5(pid=9033): Launched 07:48:37.323734 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:37.861622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9035): Launched 07:48:38.158495 run osmo-msc_10.42.42.6(pid=9036): Launched 07:48:38.326687 run osmo-stp_10.42.42.5(pid=9033): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9033)] 07:48:38.452598 run osmo-stp_10.42.42.5(pid=9033): stdout: | (launched: 2022-12-09_07:48:37.154371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:38.579350 run osmo-stp_10.42.42.5(pid=9033): stderr: | 20221209074837322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074837323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074837323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074837323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074837324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074837324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074837324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:38.703019 run osmo-stp_10.42.42.5(pid=9033): stdout: | (launched: 2022-12-09_07:48:37.154371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:38.821501 run osmo-stp_10.42.42.5(pid=9033): stderr: | 20221209074837322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074837323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074837323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074837323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074837324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074837324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074837324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:38.962549 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9033): Process ended prematurely: osmo-stp_10.42.42.5(pid=9033) [trial-2356↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9033)] [trial-2356↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 07:48:38.970828 tst assert_extension.py:17: Test FAILED (5.8 sec) 07:48:38.997457 run osmo-hlr_10.42.42.2(pid=9030): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9030)] 07:48:39.045842 run osmo-hlr_10.42.42.2(pid=9030): stdout: | (launched: 2022-12-09_07:48:36.212353) 07:48:39.095871 run osmo-hlr_10.42.42.2(pid=9030): stderr: | 20221209074836387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074836387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074836387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074836387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074836387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074836388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074836399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074836408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074836408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074836408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:39.164872 run osmo-msc_10.42.42.6(pid=9036): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9036)] 07:48:39.212807 run osmo-msc_10.42.42.6(pid=9036): stdout: | (launched: 2022-12-09_07:48:38.103034) 07:48:39.262363 run osmo-msc_10.42.42.6(pid=9036): stderr: | 20221209074838373 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074838373 DLGLOBAL DEBUG validating counter group 0x7fbb9fed4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074838373 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074838373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074838374 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074838374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074838375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074838376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074838376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074838376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:39.312437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9029): Terminating (SIGTERM) 07:48:39.352246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9032): Terminating (SIGTERM) 07:48:39.392316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9035): Terminating (SIGTERM) 07:48:39.432574 --- ParallelTerminationStrategy: PID 9029 died... 07:48:39.451749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9029): Terminated: ok {rc=0} 07:48:39.495912 --- ParallelTerminationStrategy: PID 9032 died... 07:48:39.514566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9032): Terminated: ok {rc=0} 07:48:39.558743 --- ParallelTerminationStrategy: PID 9035 died... 07:48:39.577559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9035): Terminated: ok {rc=0} 07:48:39.663930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:48:40.880482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:40.888174 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:48:40.921782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:48:40.949899 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:48:41.003240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:48:41.034345 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:48:41.062633 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:48:41.614030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:48:41.664446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:41.676248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:48:41.741803 tst mo_mt_call.py: using LAC 19992 07:48:41.860664 tst mo_mt_call.py: using RAC 102 07:48:41.979452 tst mo_mt_call.py: using CellId 19992 07:48:42.108745 tst mo_mt_call.py: using BVCI 19993 07:48:42.226770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:42.238798 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:42.250693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:42.262420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:42.274409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:42.286193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:48:42.402561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:48:42.519396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:42.990205 run create_hlr_db(pid=9041): Launched 07:48:43.118659 bus /sierra_2: Setting Powered False 07:48:44.179057 run create_hlr_db(pid=9041): Terminated: ok {rc=0} 07:48:44.601953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9043): Launched 07:48:44.905953 run osmo-hlr_10.42.42.2(pid=9044): Launched 07:48:45.021345 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:45.549485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9046): Launched 07:48:45.861428 run osmo-stp_10.42.42.5(pid=9047): Launched 07:48:46.151435 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:46.740049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9049): Launched 07:48:47.075167 run osmo-msc_10.42.42.6(pid=9050): Launched 07:48:47.390002 run osmo-stp_10.42.42.5(pid=9047): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9047)] 07:48:47.555288 run osmo-stp_10.42.42.5(pid=9047): stdout: | (launched: 2022-12-09_07:48:45.796597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:47.684072 run osmo-stp_10.42.42.5(pid=9047): stderr: | 20221209074846016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074846016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074846016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074846017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074846017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074846017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074846017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:47.810976 run osmo-stp_10.42.42.5(pid=9047): stdout: | (launched: 2022-12-09_07:48:45.796597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:47.932079 run osmo-stp_10.42.42.5(pid=9047): stderr: | 20221209074846016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074846016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074846016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074846017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074846017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074846017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074846017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:48.077019 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9047): Process ended prematurely: osmo-stp_10.42.42.5(pid=9047) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9047)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:48:48.086415 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:48:48.113931 run osmo-hlr_10.42.42.2(pid=9044): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9044)] 07:48:48.162346 run osmo-hlr_10.42.42.2(pid=9044): stdout: | (launched: 2022-12-09_07:48:44.849770) 07:48:48.212120 run osmo-hlr_10.42.42.2(pid=9044): stderr: | 20221209074845022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074845022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074845022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074845022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074845023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074845023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074845035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074845046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074845046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074845046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:48.281805 run osmo-msc_10.42.42.6(pid=9050): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9050)] 07:48:48.330000 run osmo-msc_10.42.42.6(pid=9050): stdout: | (launched: 2022-12-09_07:48:47.016704) 07:48:48.379445 run osmo-msc_10.42.42.6(pid=9050): stderr: | 20221209074847469 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074847470 DLGLOBAL DEBUG validating counter group 0x7fe78a6e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074847470 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074847470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074847470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074847470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074847472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074847472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074847472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074847472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:48.429380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9043): Terminating (SIGTERM) 07:48:48.469369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9046): Terminating (SIGTERM) 07:48:48.509503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9049): Terminating (SIGTERM) 07:48:48.549784 --- ParallelTerminationStrategy: PID 9043 died... 07:48:48.569201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9043): Terminated: ok {rc=0} 07:48:48.613641 --- ParallelTerminationStrategy: PID 9046 died... 07:48:48.632125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9046): Terminated: ok {rc=0} 07:48:48.676680 --- ParallelTerminationStrategy: PID 9049 died... 07:48:48.695483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9049): Terminated: ok {rc=0} 07:48:48.779840 bus /sierra_3: Setting Powered False 07:48:49.878347 bus /sierra_3: Setting Powered False 07:48:50.994211 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:48:52.143771 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:52.156566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:48:52.226867 tst mo_mt_call_osmux.py: using LAC 19993 07:48:52.356081 tst mo_mt_call_osmux.py: using RAC 103 07:48:52.483176 tst mo_mt_call_osmux.py: using CellId 19993 07:48:52.609735 tst mo_mt_call_osmux.py: using BVCI 19994 07:48:52.727396 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:52.739562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:52.751504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:52.763630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:52.775717 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:48:52.787709 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:48:52.907536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:48:53.029100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:53.532542 run create_hlr_db(pid=9053): Launched 07:48:53.664048 bus /sierra_2: Setting Powered False 07:48:54.726392 run create_hlr_db(pid=9053): Terminated: ok {rc=0} 07:48:55.177679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Launched 07:48:55.502455 run osmo-hlr_10.42.42.2(pid=9056): Launched 07:48:55.626899 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:56.182924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Launched 07:48:56.508149 run osmo-stp_10.42.42.5(pid=9059): Launched 07:48:56.632432 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:57.222194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9061): Launched 07:48:57.548587 run osmo-msc_10.42.42.6(pid=9062): Launched 07:48:57.729768 run osmo-stp_10.42.42.5(pid=9059): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] 07:48:57.865722 run osmo-stp_10.42.42.5(pid=9059): stdout: | (launched: 2022-12-09_07:48:56.448220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:58.001652 run osmo-stp_10.42.42.5(pid=9059): stderr: | 20221209074856638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074856638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074856638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074856638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074856639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074856639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074856639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:58.137273 run osmo-stp_10.42.42.5(pid=9059): stdout: | (launched: 2022-12-09_07:48:56.448220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:58.266845 run osmo-stp_10.42.42.5(pid=9059): stderr: | 20221209074856638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074856638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074856638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074856638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074856639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074856639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074856639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:58.422252 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9059): Process ended prematurely: osmo-stp_10.42.42.5(pid=9059) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:48:58.432023 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:48:58.460510 run osmo-hlr_10.42.42.2(pid=9056): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9056)] 07:48:58.511007 run osmo-hlr_10.42.42.2(pid=9056): stdout: | (launched: 2022-12-09_07:48:55.442925) 07:48:58.563286 run osmo-hlr_10.42.42.2(pid=9056): stderr: | 20221209074855640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074855640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074855640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074855640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074855640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074855640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074855653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074855661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074855662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074855662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:58.635984 run osmo-msc_10.42.42.6(pid=9062): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9062)] 07:48:58.685976 run osmo-msc_10.42.42.6(pid=9062): stdout: | (launched: 2022-12-09_07:48:57.488413) 07:48:58.737559 run osmo-msc_10.42.42.6(pid=9062): stderr: | 20221209074857811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074857811 DLGLOBAL DEBUG validating counter group 0x7f34f2c33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074857811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074857811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074857811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074857811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074857813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074857814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074857814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074857814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:58.789554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Terminating (SIGTERM) 07:48:58.831052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Terminating (SIGTERM) 07:48:58.872831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9061): Terminating (SIGTERM) 07:48:58.915212 --- ParallelTerminationStrategy: PID 9055 died... 07:48:58.935388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Terminated: ok {rc=0} 07:48:58.982016 --- ParallelTerminationStrategy: PID 9058 died... 07:48:59.001916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Terminated: ok {rc=0} 07:48:59.048564 --- ParallelTerminationStrategy: PID 9061 died... 07:48:59.068478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9061): Terminated: ok {rc=0} 07:48:59.155877 bus /sierra_3: Setting Powered False 07:49:00.254213 bus /sierra_3: Setting Powered False 07:49:01.378727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:49:02.625545 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:49:02.631936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:49:02.662021 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:49:02.689739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:49:02.742646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:49:02.773492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:49:02.800522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:49:03.350914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:49:03.399958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:03.411489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:49:03.477710 tst mo_mt_call.py: using LAC 19994 07:49:03.597406 tst mo_mt_call.py: using RAC 104 07:49:03.716418 tst mo_mt_call.py: using CellId 19994 07:49:03.836286 tst mo_mt_call.py: using BVCI 19995 07:49:03.947583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:03.959029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:03.970401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:03.981983 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:03.993705 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:04.005275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:49:04.126625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:49:04.247067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:04.750934 run create_hlr_db(pid=9067): Launched 07:49:04.883417 bus /sierra_2: Setting Powered False 07:49:05.947677 run create_hlr_db(pid=9067): Terminated: ok {rc=0} 07:49:06.381218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9069): Launched 07:49:06.686154 run osmo-hlr_10.42.42.2(pid=9070): Launched 07:49:06.801556 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:07.333868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9072): Launched 07:49:07.635922 run osmo-stp_10.42.42.5(pid=9073): Launched 07:49:07.751174 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:08.302312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9075): Launched 07:49:08.608345 run osmo-msc_10.42.42.6(pid=9076): Launched 07:49:08.777442 run osmo-stp_10.42.42.5(pid=9073): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9073)] 07:49:08.905666 run osmo-stp_10.42.42.5(pid=9073): stdout: | (launched: 2022-12-09_07:49:07.579750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:09.033928 run osmo-stp_10.42.42.5(pid=9073): stderr: | 20221209074907748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074907748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074907748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074907749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074907749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074907749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074907749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:09.160639 run osmo-stp_10.42.42.5(pid=9073): stdout: | (launched: 2022-12-09_07:49:07.579750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:09.281869 run osmo-stp_10.42.42.5(pid=9073): stderr: | 20221209074907748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074907748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074907748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074907749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074907749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074907749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074907749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:09.427206 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9073): Process ended prematurely: osmo-stp_10.42.42.5(pid=9073) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9073)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:49:09.436313 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:49:09.463727 run osmo-hlr_10.42.42.2(pid=9070): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9070)] 07:49:09.512050 run osmo-hlr_10.42.42.2(pid=9070): stdout: | (launched: 2022-12-09_07:49:06.629925) 07:49:09.562316 run osmo-hlr_10.42.42.2(pid=9070): stderr: | 20221209074906806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074906806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074906806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074906806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074906806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074906806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074906822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074906830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074906831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074906831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:09.631420 run osmo-msc_10.42.42.6(pid=9076): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9076)] 07:49:09.679558 run osmo-msc_10.42.42.6(pid=9076): stdout: | (launched: 2022-12-09_07:49:08.552060) 07:49:09.729393 run osmo-msc_10.42.42.6(pid=9076): stderr: | 20221209074908822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074908822 DLGLOBAL DEBUG validating counter group 0x7efdc07ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074908822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074908823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074908823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074908823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074908825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074908825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074908825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074908825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:09.779431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9069): Terminating (SIGTERM) 07:49:09.819445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9072): Terminating (SIGTERM) 07:49:09.859337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9075): Terminating (SIGTERM) 07:49:09.899456 --- ParallelTerminationStrategy: PID 9069 died... 07:49:09.918566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9069): Terminated: ok {rc=0} 07:49:09.963287 --- ParallelTerminationStrategy: PID 9072 died... 07:49:09.982168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9072): Terminated: ok {rc=0} 07:49:10.026538 --- ParallelTerminationStrategy: PID 9075 died... 07:49:10.045439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9075): Terminated: ok {rc=0} 07:49:10.129208 bus /sierra_3: Setting Powered False 07:49:11.225799 bus /sierra_3: Setting Powered False 07:49:12.339470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:49:13.488139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:13.501050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:49:13.571268 tst mo_mt_call_osmux.py: using LAC 19995 07:49:13.700337 tst mo_mt_call_osmux.py: using RAC 105 07:49:13.821911 tst mo_mt_call_osmux.py: using CellId 19995 07:49:13.943513 tst mo_mt_call_osmux.py: using BVCI 19996 07:49:14.055177 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:14.066942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:14.078509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:14.090445 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:14.102166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:49:14.113773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:49:14.235661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:49:14.353527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:14.824659 run create_hlr_db(pid=9078): Launched 07:49:14.939890 bus /sierra_2: Setting Powered False 07:49:16.002510 run create_hlr_db(pid=9078): Terminated: ok {rc=0} 07:49:16.434507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9080): Launched 07:49:16.761762 run osmo-hlr_10.42.42.2(pid=9081): Launched 07:49:16.985100 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:17.566262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9083): Launched 07:49:17.870644 run osmo-stp_10.42.42.5(pid=9084): Launched 07:49:17.988023 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:18.539375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9086): Launched 07:49:18.842868 run osmo-msc_10.42.42.6(pid=9087): Launched 07:49:19.011229 run osmo-stp_10.42.42.5(pid=9084): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9084)] 07:49:19.139525 run osmo-stp_10.42.42.5(pid=9084): stdout: | (launched: 2022-12-09_07:49:17.814160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:19.267584 run osmo-stp_10.42.42.5(pid=9084): stderr: | 20221209074917982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074917982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074917982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074917983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074917983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074917983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074917983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:19.393926 run osmo-stp_10.42.42.5(pid=9084): stdout: | (launched: 2022-12-09_07:49:17.814160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:19.514627 run osmo-stp_10.42.42.5(pid=9084): stderr: | 20221209074917982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074917982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074917982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074917983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074917983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074917983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074917983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:19.659480 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9084): Process ended prematurely: osmo-stp_10.42.42.5(pid=9084) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9084)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:49:19.668787 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:49:19.696343 run osmo-hlr_10.42.42.2(pid=9081): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9081)] 07:49:19.744629 run osmo-hlr_10.42.42.2(pid=9081): stdout: | (launched: 2022-12-09_07:49:16.699884) 07:49:19.794565 run osmo-hlr_10.42.42.2(pid=9081): stderr: | 20221209074916906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074916906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074916906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074916906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074916906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074916906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074916921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074916946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074916946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074916946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:19.864082 run osmo-msc_10.42.42.6(pid=9087): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9087)] 07:49:19.912147 run osmo-msc_10.42.42.6(pid=9087): stdout: | (launched: 2022-12-09_07:49:18.786666) 07:49:19.961746 run osmo-msc_10.42.42.6(pid=9087): stderr: | 20221209074919057 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074919057 DLGLOBAL DEBUG validating counter group 0x7fd597790c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074919057 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074919057 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074919057 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074919058 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074919059 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074919060 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074919060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074919060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:20.011919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9080): Terminating (SIGTERM) 07:49:20.052509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9083): Terminating (SIGTERM) 07:49:20.092817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9086): Terminating (SIGTERM) 07:49:20.133562 --- ParallelTerminationStrategy: PID 9080 died... 07:49:20.152313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9080): Terminated: ok {rc=0} 07:49:20.197768 --- ParallelTerminationStrategy: PID 9083 died... 07:49:20.216669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9083): Terminated: ok {rc=0} 07:49:20.261372 --- ParallelTerminationStrategy: PID 9086 died... 07:49:20.280215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9086): Terminated: ok {rc=0} 07:49:20.368207 bus /sierra_3: Setting Powered False 07:49:21.468824 bus /sierra_3: Setting Powered False 07:49:22.586964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:49:23.833883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:49:23.841423 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:49:23.871929 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:49:23.899857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:49:23.954142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:49:23.984627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:49:24.012645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:49:24.567470 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:49:24.619764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:24.631681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:49:24.700215 tst mo_mt_call.py: using LAC 19996 07:49:24.827983 tst mo_mt_call.py: using RAC 106 07:49:24.956009 tst mo_mt_call.py: using CellId 19996 07:49:25.082108 tst mo_mt_call.py: using BVCI 19997 07:49:25.199338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:25.211782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:25.223525 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:25.235237 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:25.247215 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:25.259069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:49:25.374690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:49:25.490248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:25.959479 run create_hlr_db(pid=9092): Launched 07:49:26.074884 bus /sierra_2: Setting Powered False 07:49:27.135288 run create_hlr_db(pid=9092): Terminated: ok {rc=0} 07:49:27.578906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9094): Launched 07:49:27.902966 run osmo-hlr_10.42.42.2(pid=9095): Launched 07:49:28.026410 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:28.585390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9097): Launched 07:49:28.908374 run osmo-stp_10.42.42.5(pid=9098): Launched 07:49:29.031909 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:29.621748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9100): Launched 07:49:29.945813 run osmo-msc_10.42.42.6(pid=9101): Launched 07:49:30.127227 run osmo-stp_10.42.42.5(pid=9098): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9098)] 07:49:30.263740 run osmo-stp_10.42.42.5(pid=9098): stdout: | (launched: 2022-12-09_07:49:28.848850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:30.399937 run osmo-stp_10.42.42.5(pid=9098): stderr: | 20221209074929039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074929039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074929039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074929040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074929040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074929040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074929040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:30.535593 run osmo-stp_10.42.42.5(pid=9098): stdout: | (launched: 2022-12-09_07:49:28.848850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:30.665141 run osmo-stp_10.42.42.5(pid=9098): stderr: | 20221209074929039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074929039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074929039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074929040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074929040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074929040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074929040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:30.820248 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9098): Process ended prematurely: osmo-stp_10.42.42.5(pid=9098) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9098)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:49:30.832260 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:49:30.864122 run osmo-hlr_10.42.42.2(pid=9095): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9095)] 07:49:30.926102 run osmo-hlr_10.42.42.2(pid=9095): stdout: | (launched: 2022-12-09_07:49:27.842920) 07:49:30.978512 run osmo-hlr_10.42.42.2(pid=9095): stderr: | 20221209074928040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074928040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074928040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074928040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074928040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074928040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074928053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074928061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074928062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074928062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:31.051949 run osmo-msc_10.42.42.6(pid=9101): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9101)] 07:49:31.102832 run osmo-msc_10.42.42.6(pid=9101): stdout: | (launched: 2022-12-09_07:49:29.885995) 07:49:31.155340 run osmo-msc_10.42.42.6(pid=9101): stderr: | 20221209074930207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074930207 DLGLOBAL DEBUG validating counter group 0x7f1e95dcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074930207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074930207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074930208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074930208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074930209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074930210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074930210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074930210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:31.208372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9094): Terminating (SIGTERM) 07:49:31.250909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9097): Terminating (SIGTERM) 07:49:31.294057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9100): Terminating (SIGTERM) 07:49:31.338310 --- ParallelTerminationStrategy: PID 9094 died... 07:49:31.358613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9094): Terminated: ok {rc=0} 07:49:31.405519 --- ParallelTerminationStrategy: PID 9097 died... 07:49:31.425624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9097): Terminated: ok {rc=0} 07:49:31.472304 --- ParallelTerminationStrategy: PID 9100 died... 07:49:31.492521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9100): Terminated: ok {rc=0} 07:49:31.580528 bus /sierra_3: Setting Powered False 07:49:32.678084 bus /sierra_3: Setting Powered False 07:49:33.793981 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:49:34.939697 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:34.952051 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:49:35.018497 tst mo_mt_call_osmux.py: using LAC 19997 07:49:35.137879 tst mo_mt_call_osmux.py: using RAC 107 07:49:35.268473 tst mo_mt_call_osmux.py: using CellId 19997 07:49:35.390812 tst mo_mt_call_osmux.py: using BVCI 19998 07:49:35.500889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:35.512560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:35.524094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:35.535971 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:35.547809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:49:35.559781 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:49:35.680411 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:49:35.799192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:36.272205 run create_hlr_db(pid=9103): Launched 07:49:36.387565 bus /sierra_2: Setting Powered False 07:49:37.447374 run create_hlr_db(pid=9103): Terminated: ok {rc=0} 07:49:37.870968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Launched 07:49:38.176699 run osmo-hlr_10.42.42.2(pid=9106): Launched 07:49:38.292235 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:38.814213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Launched 07:49:39.118205 run osmo-stp_10.42.42.5(pid=9109): Launched 07:49:39.234249 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:39.783367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Launched 07:49:40.087020 run osmo-msc_10.42.42.6(pid=9112): Launched 07:49:40.257227 run osmo-stp_10.42.42.5(pid=9109): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] 07:49:40.385105 run osmo-stp_10.42.42.5(pid=9109): stdout: | (launched: 2022-12-09_07:49:39.061810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:40.514026 run osmo-stp_10.42.42.5(pid=9109): stderr: | 20221209074939230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074939231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074939231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074939231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074939232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074939232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074939232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:40.639838 run osmo-stp_10.42.42.5(pid=9109): stdout: | (launched: 2022-12-09_07:49:39.061810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:40.761084 run osmo-stp_10.42.42.5(pid=9109): stderr: | 20221209074939230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074939231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074939231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074939231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074939232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074939232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074939232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:40.905273 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9109): Process ended prematurely: osmo-stp_10.42.42.5(pid=9109) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:49:40.914367 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:49:40.941431 run osmo-hlr_10.42.42.2(pid=9106): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9106)] 07:49:40.989849 run osmo-hlr_10.42.42.2(pid=9106): stdout: | (launched: 2022-12-09_07:49:38.120448) 07:49:41.039698 run osmo-hlr_10.42.42.2(pid=9106): stderr: | 20221209074938296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074938296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074938296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074938296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074938296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074938296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074938311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074938321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074938322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074938322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:41.108905 run osmo-msc_10.42.42.6(pid=9112): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9112)] 07:49:41.156853 run osmo-msc_10.42.42.6(pid=9112): stdout: | (launched: 2022-12-09_07:49:40.030416) 07:49:41.206245 run osmo-msc_10.42.42.6(pid=9112): stderr: | 20221209074940301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074940301 DLGLOBAL DEBUG validating counter group 0x7f7966f87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074940301 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074940301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074940301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074940302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074940303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074940304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074940304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074940304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:41.256286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Terminating (SIGTERM) 07:49:41.295954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Terminating (SIGTERM) 07:49:41.335869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Terminating (SIGTERM) 07:49:41.376196 --- ParallelTerminationStrategy: PID 9105 died... 07:49:41.395439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Terminated: ok {rc=0} 07:49:41.440541 --- ParallelTerminationStrategy: PID 9108 died... 07:49:41.459482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Terminated: ok {rc=0} 07:49:41.504413 --- ParallelTerminationStrategy: PID 9111 died... 07:49:41.523353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Terminated: ok {rc=0} 07:49:41.609958 bus /sierra_3: Setting Powered False 07:49:42.708488 bus /sierra_3: Setting Powered False 07:49:43.823542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:49:45.077042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:49:45.084169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:49:45.114654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:49:45.142425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:49:45.195604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:49:45.226859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:49:45.254925 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:49:45.809620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:49:45.868304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:45.880832 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:49:45.969006 tst mo_mt_call.py: using LAC 19998 07:49:46.097458 tst mo_mt_call.py: using RAC 108 07:49:46.228200 tst mo_mt_call.py: using CellId 19998 07:49:46.389690 tst mo_mt_call.py: using BVCI 19999 07:49:46.537796 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:46.551900 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:46.564163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:46.576938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:46.589786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:46.602198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:49:46.752148 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:49:46.886734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:47.376726 run create_hlr_db(pid=9117): Launched 07:49:47.492807 bus /sierra_2: Setting Powered False 07:49:48.553570 run create_hlr_db(pid=9117): Terminated: ok {rc=0} 07:49:48.999282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9119): Launched 07:49:49.325699 run osmo-hlr_10.42.42.2(pid=9120): Launched 07:49:49.449459 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:50.010290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9122): Launched 07:49:50.335163 run osmo-stp_10.42.42.5(pid=9123): Launched 07:49:50.459226 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:51.046701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9125): Launched 07:49:51.373774 run osmo-msc_10.42.42.6(pid=9126): Launched 07:49:51.555546 run osmo-stp_10.42.42.5(pid=9123): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9123)] 07:49:51.691939 run osmo-stp_10.42.42.5(pid=9123): stdout: | (launched: 2022-12-09_07:49:50.275450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:51.829081 run osmo-stp_10.42.42.5(pid=9123): stderr: | 20221209074950468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074950468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074950469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074950469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074950470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074950470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074950470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:51.964587 run osmo-stp_10.42.42.5(pid=9123): stdout: | (launched: 2022-12-09_07:49:50.275450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:52.094365 run osmo-stp_10.42.42.5(pid=9123): stderr: | 20221209074950468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209074950468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209074950469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209074950469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209074950470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209074950470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209074950470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:52.249409 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9123): Process ended prematurely: osmo-stp_10.42.42.5(pid=9123) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9123)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:49:52.259148 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:49:52.287278 run osmo-hlr_10.42.42.2(pid=9120): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9120)] 07:49:52.337499 run osmo-hlr_10.42.42.2(pid=9120): stdout: | (launched: 2022-12-09_07:49:49.266041) 07:49:52.389514 run osmo-hlr_10.42.42.2(pid=9120): stderr: | 20221209074949463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074949463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074949463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074949463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074949463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074949463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074949475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074949484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074949484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074949484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:52.462028 run osmo-msc_10.42.42.6(pid=9126): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9126)] 07:49:52.512163 run osmo-msc_10.42.42.6(pid=9126): stdout: | (launched: 2022-12-09_07:49:51.313618) 07:49:52.564296 run osmo-msc_10.42.42.6(pid=9126): stderr: | 20221209074951635 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209074951635 DLGLOBAL DEBUG validating counter group 0x7f571c205c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209074951635 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209074951635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209074951635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209074951635 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209074951637 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209074951638 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209074951638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209074951638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:52.615971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9119): Terminating (SIGTERM) 07:49:52.657705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9122): Terminating (SIGTERM) 07:49:52.699691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9125): Terminating (SIGTERM) 07:49:52.741839 --- ParallelTerminationStrategy: PID 9119 died... 07:49:52.761839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9119): Terminated: ok {rc=0} 07:49:52.808099 --- ParallelTerminationStrategy: PID 9122 died... 07:49:52.828079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9122): Terminated: ok {rc=0} 07:49:52.874147 --- ParallelTerminationStrategy: PID 9125 died... 07:49:52.893633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9125): Terminated: ok {rc=0} 07:49:52.981152 bus /sierra_3: Setting Powered False 07:49:54.080219 bus /sierra_3: Setting Powered False 07:49:55.196086 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:49:56.345690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:56.358308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:49:56.427114 tst mo_mt_call_osmux.py: using LAC 19999 07:49:56.554576 tst mo_mt_call_osmux.py: using RAC 109 07:49:56.683311 tst mo_mt_call_osmux.py: using CellId 19999 07:49:56.811423 tst mo_mt_call_osmux.py: using BVCI 20000 07:49:56.931552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:56.943511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:56.955192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:56.966896 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:56.979120 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:49:56.990911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:49:57.108161 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:49:57.226312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:57.696051 run create_hlr_db(pid=9128): Launched 07:49:57.811347 bus /sierra_2: Setting Powered False 07:49:58.871526 run create_hlr_db(pid=9128): Terminated: ok {rc=0} 07:49:59.293227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9130): Launched 07:49:59.596006 run osmo-hlr_10.42.42.2(pid=9131): Launched 07:49:59.711440 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:00.235259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9133): Launched 07:50:00.538486 run osmo-stp_10.42.42.5(pid=9134): Launched 07:50:00.653272 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:01.221684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9136): Launched 07:50:01.534930 run osmo-msc_10.42.42.6(pid=9137): Launched 07:50:01.889752 run osmo-stp_10.42.42.5(pid=9134): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9134)] 07:50:02.161939 run osmo-stp_10.42.42.5(pid=9134): stdout: | (launched: 2022-12-09_07:50:00.482037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:02.398950 run osmo-stp_10.42.42.5(pid=9134): stderr: | 20221209075000653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075000654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075000654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075000654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075000655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075000655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075000655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:02.531846 run osmo-stp_10.42.42.5(pid=9134): stdout: | (launched: 2022-12-09_07:50:00.482037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:02.656804 run osmo-stp_10.42.42.5(pid=9134): stderr: | 20221209075000653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075000654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075000654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075000654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075000655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075000655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075000655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:02.805273 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9134): Process ended prematurely: osmo-stp_10.42.42.5(pid=9134) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9134)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:50:02.814420 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:50:02.842435 run osmo-hlr_10.42.42.2(pid=9131): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9131)] 07:50:02.891132 run osmo-hlr_10.42.42.2(pid=9131): stdout: | (launched: 2022-12-09_07:49:59.539739) 07:50:02.941397 run osmo-hlr_10.42.42.2(pid=9131): stderr: | 20221209074959715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209074959715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209074959715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209074959715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209074959715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209074959716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209074959727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209074959736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209074959736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209074959736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:03.011017 run osmo-msc_10.42.42.6(pid=9137): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9137)] 07:50:03.059641 run osmo-msc_10.42.42.6(pid=9137): stdout: | (launched: 2022-12-09_07:50:01.477610) 07:50:03.109304 run osmo-msc_10.42.42.6(pid=9137): stderr: | 20221209075002035 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075002035 DLGLOBAL DEBUG validating counter group 0x7f4a74a21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075002035 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075002036 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075002036 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075002036 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075002045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075002046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075002046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075002046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:03.159686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9130): Terminating (SIGTERM) 07:50:03.199321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9133): Terminating (SIGTERM) 07:50:03.238769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9136): Terminating (SIGTERM) 07:50:03.278943 --- ParallelTerminationStrategy: PID 9130 died... 07:50:03.298609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9130): Terminated: ok {rc=0} 07:50:03.342841 --- ParallelTerminationStrategy: PID 9133 died... 07:50:03.362114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9133): Terminated: ok {rc=0} 07:50:03.406541 --- ParallelTerminationStrategy: PID 9136 died... 07:50:03.425551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9136): Terminated: ok {rc=0} 07:50:03.510627 bus /sierra_3: Setting Powered False 07:50:04.609794 bus /sierra_3: Setting Powered False 07:50:05.721306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:50:06.971379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:06.977915 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:50:07.008272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:50:07.036514 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:50:07.089368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:50:07.119932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:50:07.147270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:50:07.703893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:50:07.753648 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:07.765155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:50:07.830854 tst mo_mt_call.py: using LAC 20000 07:50:07.949392 tst mo_mt_call.py: using RAC 110 07:50:08.073462 tst mo_mt_call.py: using CellId 20000 07:50:08.192733 tst mo_mt_call.py: using BVCI 20001 07:50:08.302489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:08.314041 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:08.325409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:08.337122 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:08.348936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:08.360587 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:50:08.480178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:50:08.597949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:09.070036 run create_hlr_db(pid=9152): Launched 07:50:09.186325 bus /sierra_2: Setting Powered False 07:50:10.247954 run create_hlr_db(pid=9152): Terminated: ok {rc=0} 07:50:10.692891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9154): Launched 07:50:11.021184 run osmo-hlr_10.42.42.2(pid=9155): Launched 07:50:11.146036 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:11.708535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9157): Launched 07:50:12.034404 run osmo-stp_10.42.42.5(pid=9158): Launched 07:50:12.156784 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:12.752283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9163): Launched 07:50:13.087741 run osmo-msc_10.42.42.6(pid=9192): Launched 07:50:13.305696 run osmo-stp_10.42.42.5(pid=9158): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9158)] 07:50:13.502312 run osmo-stp_10.42.42.5(pid=9158): stdout: | (launched: 2022-12-09_07:50:11.973848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:13.690417 run osmo-stp_10.42.42.5(pid=9158): stderr: | 20221209075012166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075012166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075012166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075012167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075012167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075012167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075012167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:13.853848 run osmo-stp_10.42.42.5(pid=9158): stdout: | (launched: 2022-12-09_07:50:11.973848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:13.985640 run osmo-stp_10.42.42.5(pid=9158): stderr: | 20221209075012166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075012166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075012166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075012167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075012167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075012167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075012167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:14.138365 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9158): Process ended prematurely: osmo-stp_10.42.42.5(pid=9158) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9158)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:50:14.147662 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:50:14.176447 run osmo-hlr_10.42.42.2(pid=9155): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9155)] 07:50:14.225805 run osmo-hlr_10.42.42.2(pid=9155): stdout: | (launched: 2022-12-09_07:50:10.960385) 07:50:14.278494 run osmo-hlr_10.42.42.2(pid=9155): stderr: | 20221209075011161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075011161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075011161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075011161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075011161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075011161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075011173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075011182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075011182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075011182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:14.350869 run osmo-msc_10.42.42.6(pid=9192): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9192)] 07:50:14.401126 run osmo-msc_10.42.42.6(pid=9192): stdout: | (launched: 2022-12-09_07:50:13.026749) 07:50:14.452412 run osmo-msc_10.42.42.6(pid=9192): stderr: | 20221209075013548 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075013548 DLGLOBAL DEBUG validating counter group 0x7faf08a38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075013549 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075013549 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075013549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075013549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075013551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075013551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075013551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075013551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:14.505568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9154): Terminating (SIGTERM) 07:50:14.548266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9157): Terminating (SIGTERM) 07:50:14.591107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9163): Terminating (SIGTERM) 07:50:14.634277 --- ParallelTerminationStrategy: PID 9154 died... 07:50:14.654342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9154): Terminated: ok {rc=0} 07:50:14.701839 --- ParallelTerminationStrategy: PID 9157 died... 07:50:14.721862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9157): Terminated: ok {rc=0} 07:50:14.770236 --- ParallelTerminationStrategy: PID 9163 died... 07:50:14.790444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9163): Terminated: ok {rc=0} 07:50:14.879440 bus /sierra_3: Setting Powered False 07:50:15.978884 bus /sierra_3: Setting Powered False 07:50:17.103466 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:50:18.248786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:18.261183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:50:18.327229 tst mo_mt_call_osmux.py: using LAC 20001 07:50:18.448177 tst mo_mt_call_osmux.py: using RAC 111 07:50:18.568558 tst mo_mt_call_osmux.py: using CellId 20001 07:50:18.687194 tst mo_mt_call_osmux.py: using BVCI 20002 07:50:18.798381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:18.810054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:18.821390 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:18.832823 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:18.844299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:50:18.855689 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:50:18.973957 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:50:19.093132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:19.564657 run create_hlr_db(pid=9514): Launched 07:50:19.680351 bus /sierra_2: Setting Powered False 07:50:20.740860 run create_hlr_db(pid=9514): Terminated: ok {rc=0} 07:50:21.185738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Launched 07:50:21.512036 run osmo-hlr_10.42.42.2(pid=9517): Launched 07:50:21.637870 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:22.195158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Launched 07:50:22.520845 run osmo-stp_10.42.42.5(pid=9520): Launched 07:50:22.646343 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:23.234515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Launched 07:50:23.566833 run osmo-msc_10.42.42.6(pid=9551): Launched 07:50:23.814305 run osmo-stp_10.42.42.5(pid=9520): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] 07:50:24.008474 run osmo-stp_10.42.42.5(pid=9520): stdout: | (launched: 2022-12-09_07:50:22.460812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:24.241787 run osmo-stp_10.42.42.5(pid=9520): stderr: | 20221209075022653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075022653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075022653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075022653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075022654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075022654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075022654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:24.454929 run osmo-stp_10.42.42.5(pid=9520): stdout: | (launched: 2022-12-09_07:50:22.460812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:24.587519 run osmo-stp_10.42.42.5(pid=9520): stderr: | 20221209075022653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075022653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075022653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075022653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075022654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075022654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075022654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:24.744636 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9520): Process ended prematurely: osmo-stp_10.42.42.5(pid=9520) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:50:24.755316 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:50:24.784363 run osmo-hlr_10.42.42.2(pid=9517): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9517)] 07:50:24.835563 run osmo-hlr_10.42.42.2(pid=9517): stdout: | (launched: 2022-12-09_07:50:21.452113) 07:50:24.888305 run osmo-hlr_10.42.42.2(pid=9517): stderr: | 20221209075021649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075021649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075021649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075021649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075021649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075021649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075021661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075021670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075021670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075021670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:24.961970 run osmo-msc_10.42.42.6(pid=9551): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9551)] 07:50:25.013085 run osmo-msc_10.42.42.6(pid=9551): stdout: | (launched: 2022-12-09_07:50:23.509171) 07:50:25.065843 run osmo-msc_10.42.42.6(pid=9551): stderr: | 20221209075024078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075024079 DLGLOBAL DEBUG validating counter group 0x7f297495ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075024079 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075024079 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075024079 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075024079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075024085 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075024086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075024086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075024086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:25.119552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Terminating (SIGTERM) 07:50:25.162647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Terminating (SIGTERM) 07:50:25.207563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Terminating (SIGTERM) 07:50:25.253475 --- ParallelTerminationStrategy: PID 9516 died... 07:50:25.274273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Terminated: ok {rc=0} 07:50:25.323609 --- ParallelTerminationStrategy: PID 9519 died... 07:50:25.344363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Terminated: ok {rc=0} 07:50:25.391623 --- ParallelTerminationStrategy: PID 9522 died... 07:50:25.412275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Terminated: ok {rc=0} 07:50:25.502077 bus /sierra_3: Setting Powered False 07:50:26.602507 bus /sierra_3: Setting Powered False 07:50:27.721315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:50:28.981485 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:28.989714 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:50:29.020912 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:50:29.050552 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:50:29.104578 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:50:29.136873 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:50:29.166893 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:50:29.716170 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:50:29.769776 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:29.781894 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:50:29.850360 tst mo_mt_call.py: using LAC 20002 07:50:29.979661 tst mo_mt_call.py: using RAC 112 07:50:30.112099 tst mo_mt_call.py: using CellId 20002 07:50:30.238367 tst mo_mt_call.py: using BVCI 20003 07:50:30.355780 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:30.367760 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:30.379497 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:30.391273 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:30.403051 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:30.414839 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:50:30.531673 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:50:30.647444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:31.183857 run create_hlr_db(pid=9704): Launched 07:50:31.341139 bus /sierra_2: Setting Powered False 07:50:32.401375 run create_hlr_db(pid=9704): Terminated: ok {rc=0} 07:50:32.826459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Launched 07:50:33.131617 run osmo-hlr_10.42.42.2(pid=9707): Launched 07:50:33.247162 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:33.781430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Launched 07:50:34.085564 run osmo-stp_10.42.42.5(pid=9710): Launched 07:50:34.200124 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:34.749508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9712): Launched 07:50:35.053906 run osmo-msc_10.42.42.6(pid=9713): Launched 07:50:35.225814 run osmo-stp_10.42.42.5(pid=9710): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] 07:50:35.354941 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-09_07:50:34.029197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:35.483466 run osmo-stp_10.42.42.5(pid=9710): stderr: | 20221209075034200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075034200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075034200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075034201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075034201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075034201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075034201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:35.609621 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-09_07:50:34.029197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:35.730894 run osmo-stp_10.42.42.5(pid=9710): stderr: | 20221209075034200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075034200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075034200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075034201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075034201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075034201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075034201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:35.876155 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:50:35.885392 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:50:35.912391 run osmo-hlr_10.42.42.2(pid=9707): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9707)] 07:50:35.959882 run osmo-hlr_10.42.42.2(pid=9707): stdout: | (launched: 2022-12-09_07:50:33.074673) 07:50:36.009155 run osmo-hlr_10.42.42.2(pid=9707): stderr: | 20221209075033249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075033249 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075033249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075033249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075033249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075033249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075033261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075033270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075033270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075033270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:36.077731 run osmo-msc_10.42.42.6(pid=9713): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9713)] 07:50:36.125013 run osmo-msc_10.42.42.6(pid=9713): stdout: | (launched: 2022-12-09_07:50:34.997118) 07:50:36.174033 run osmo-msc_10.42.42.6(pid=9713): stderr: | 20221209075035271 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075035271 DLGLOBAL DEBUG validating counter group 0x7fbb63f53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075035271 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075035271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075035271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075035271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075035273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075035274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075035274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075035274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:36.223529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminating (SIGTERM) 07:50:36.262785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminating (SIGTERM) 07:50:36.302025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9712): Terminating (SIGTERM) 07:50:36.341741 --- ParallelTerminationStrategy: PID 9706 died... 07:50:36.360744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminated: ok {rc=0} 07:50:36.404936 --- ParallelTerminationStrategy: PID 9709 died... 07:50:36.423659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminated: ok {rc=0} 07:50:36.467638 --- ParallelTerminationStrategy: PID 9712 died... 07:50:36.486298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9712): Terminated: ok {rc=0} 07:50:36.569178 bus /sierra_3: Setting Powered False 07:50:37.666624 bus /sierra_3: Setting Powered False 07:50:38.781849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:50:39.931715 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:39.944554 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:50:40.014778 tst mo_mt_call_osmux.py: using LAC 20003 07:50:40.142700 tst mo_mt_call_osmux.py: using RAC 113 07:50:40.269688 tst mo_mt_call_osmux.py: using CellId 20003 07:50:40.398185 tst mo_mt_call_osmux.py: using BVCI 20004 07:50:40.517458 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:40.529563 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:40.541541 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:40.553413 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:40.565558 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:50:40.577352 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:50:40.698822 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:50:40.815529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:41.288568 run create_hlr_db(pid=9715): Launched 07:50:41.421922 bus /sierra_2: Setting Powered False 07:50:42.485961 run create_hlr_db(pid=9715): Terminated: ok {rc=0} 07:50:42.938498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Launched 07:50:43.265031 run osmo-hlr_10.42.42.2(pid=9718): Launched 07:50:43.389486 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:43.947458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Launched 07:50:44.274786 run osmo-stp_10.42.42.5(pid=9721): Launched 07:50:44.400423 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:44.990603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Launched 07:50:45.317213 run osmo-msc_10.42.42.6(pid=9724): Launched 07:50:45.498756 run osmo-stp_10.42.42.5(pid=9721): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] 07:50:45.634966 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-09_07:50:44.213807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:45.771596 run osmo-stp_10.42.42.5(pid=9721): stderr: | 20221209075044405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075044405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075044405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075044406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075044406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075044406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075044406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:45.923339 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-09_07:50:44.213807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:46.059374 run osmo-stp_10.42.42.5(pid=9721): stderr: | 20221209075044405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075044405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075044405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075044406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075044406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075044406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075044406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:46.212809 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:50:46.223039 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:50:46.253486 run osmo-hlr_10.42.42.2(pid=9718): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9718)] 07:50:46.305453 run osmo-hlr_10.42.42.2(pid=9718): stdout: | (launched: 2022-12-09_07:50:43.204181) 07:50:46.357784 run osmo-hlr_10.42.42.2(pid=9718): stderr: | 20221209075043403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075043403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075043403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075043404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075043404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075043404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075043416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075043424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075043424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075043424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:46.430875 run osmo-msc_10.42.42.6(pid=9724): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9724)] 07:50:46.483686 run osmo-msc_10.42.42.6(pid=9724): stdout: | (launched: 2022-12-09_07:50:45.256756) 07:50:46.536363 run osmo-msc_10.42.42.6(pid=9724): stderr: | 20221209075045579 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075045580 DLGLOBAL DEBUG validating counter group 0x7fb734c91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075045580 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075045580 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075045580 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075045580 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075045582 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075045582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075045582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075045582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:46.589821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminating (SIGTERM) 07:50:46.632575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminating (SIGTERM) 07:50:46.679032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Terminating (SIGTERM) 07:50:46.724469 --- ParallelTerminationStrategy: PID 9717 died... 07:50:46.744817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminated: ok {rc=0} 07:50:46.794599 --- ParallelTerminationStrategy: PID 9720 died... 07:50:46.814528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminated: ok {rc=0} 07:50:46.862347 --- ParallelTerminationStrategy: PID 9723 died... 07:50:46.883114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Terminated: ok {rc=0} 07:50:46.979106 bus /sierra_3: Setting Powered False 07:50:48.090862 bus /sierra_3: Setting Powered False 07:50:49.205454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:50:50.452672 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:50.458522 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:50:50.488720 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:50:50.515702 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:50:50.565810 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:50:50.595282 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:50:50.622008 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:50:51.176016 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:50:51.224792 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:50:51.236107 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:50:51.301622 tst mo_mt_call.py: using LAC 20004 07:50:51.428762 tst mo_mt_call.py: using RAC 114 07:50:51.554307 tst mo_mt_call.py: using CellId 20004 07:50:51.680319 tst mo_mt_call.py: using BVCI 20005 07:50:51.798095 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:50:51.810018 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:50:51.821768 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:50:51.833659 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:50:51.845712 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:50:51.857467 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:50:51.977245 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:50:52.095052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:52.568770 run create_hlr_db(pid=9730): Launched 07:50:52.684740 bus /sierra_2: Setting Powered False 07:50:53.744346 run create_hlr_db(pid=9730): Terminated: ok {rc=0} 07:50:54.189424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Launched 07:50:54.515052 run osmo-hlr_10.42.42.2(pid=9733): Launched 07:50:54.639917 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:55.200477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Launched 07:50:55.527064 run osmo-stp_10.42.42.5(pid=9736): Launched 07:50:55.651209 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:56.236626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9738): Launched 07:50:56.564560 run osmo-msc_10.42.42.6(pid=9739): Launched 07:50:56.746816 run osmo-stp_10.42.42.5(pid=9736): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] 07:50:56.886641 run osmo-stp_10.42.42.5(pid=9736): stdout: | (launched: 2022-12-09_07:50:55.467406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:57.023469 run osmo-stp_10.42.42.5(pid=9736): stderr: | 20221209075055657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075055658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075055658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075055658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075055659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075055659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075055659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:57.158119 run osmo-stp_10.42.42.5(pid=9736): stdout: | (launched: 2022-12-09_07:50:55.467406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:57.287403 run osmo-stp_10.42.42.5(pid=9736): stderr: | 20221209075055657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075055658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075055658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075055658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075055659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075055659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075055659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:57.442508 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9736): Process ended prematurely: osmo-stp_10.42.42.5(pid=9736) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:50:57.452188 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:50:57.480175 run osmo-hlr_10.42.42.2(pid=9733): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9733)] 07:50:57.529643 run osmo-hlr_10.42.42.2(pid=9733): stdout: | (launched: 2022-12-09_07:50:54.455443) 07:50:57.580628 run osmo-hlr_10.42.42.2(pid=9733): stderr: | 20221209075054651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075054651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075054651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075054651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075054651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075054651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075054663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075054673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075054673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075054673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:57.651915 run osmo-msc_10.42.42.6(pid=9739): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9739)] 07:50:57.701310 run osmo-msc_10.42.42.6(pid=9739): stdout: | (launched: 2022-12-09_07:50:56.504159) 07:50:57.752367 run osmo-msc_10.42.42.6(pid=9739): stderr: | 20221209075056826 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075056826 DLGLOBAL DEBUG validating counter group 0x7fb77e7d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075056827 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075056827 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075056827 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075056827 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075056829 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075056829 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075056829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075056829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:57.803546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Terminating (SIGTERM) 07:50:57.844253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Terminating (SIGTERM) 07:50:57.885146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9738): Terminating (SIGTERM) 07:50:57.926410 --- ParallelTerminationStrategy: PID 9732 died... 07:50:57.946244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Terminated: ok {rc=0} 07:50:57.991946 --- ParallelTerminationStrategy: PID 9735 died... 07:50:58.011700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Terminated: ok {rc=0} 07:50:58.057533 --- ParallelTerminationStrategy: PID 9738 died... 07:50:58.077198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9738): Terminated: ok {rc=0} 07:50:58.163682 bus /sierra_3: Setting Powered False 07:50:59.262568 bus /sierra_3: Setting Powered False 07:51:00.377943 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:51:01.526704 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:51:01.539209 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:51:01.608358 tst mo_mt_call_osmux.py: using LAC 20005 07:51:01.758049 tst mo_mt_call_osmux.py: using RAC 115 07:51:01.879318 tst mo_mt_call_osmux.py: using CellId 20005 07:51:02.029408 tst mo_mt_call_osmux.py: using BVCI 20006 07:51:02.143461 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:51:02.155565 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:51:02.167171 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:51:02.179189 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:51:02.191175 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:51:02.202888 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:51:02.318587 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:51:02.436764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:02.945064 run create_hlr_db(pid=9741): Launched 07:51:03.077080 bus /sierra_2: Setting Powered False 07:51:04.140798 run create_hlr_db(pid=9741): Terminated: ok {rc=0} 07:51:04.593486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9743): Launched 07:51:04.919119 run osmo-hlr_10.42.42.2(pid=9744): Launched 07:51:05.043668 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:05.602840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9746): Launched 07:51:05.929361 run osmo-stp_10.42.42.5(pid=9747): Launched 07:51:06.051450 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:06.636328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9749): Launched 07:51:06.962834 run osmo-msc_10.42.42.6(pid=9750): Launched 07:51:07.144269 run osmo-stp_10.42.42.5(pid=9747): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9747)] 07:51:07.280257 run osmo-stp_10.42.42.5(pid=9747): stdout: | (launched: 2022-12-09_07:51:05.868927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:07.417137 run osmo-stp_10.42.42.5(pid=9747): stderr: | 20221209075106061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075106061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075106062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075106062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075106063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075106063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075106063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:07.552584 run osmo-stp_10.42.42.5(pid=9747): stdout: | (launched: 2022-12-09_07:51:05.868927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:07.682187 run osmo-stp_10.42.42.5(pid=9747): stderr: | 20221209075106061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075106061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075106062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075106062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075106063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075106063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075106063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:07.837012 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9747): Process ended prematurely: osmo-stp_10.42.42.5(pid=9747) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9747)] [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:51:07.846903 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:51:07.875186 run osmo-hlr_10.42.42.2(pid=9744): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9744)] 07:51:07.925058 run osmo-hlr_10.42.42.2(pid=9744): stdout: | (launched: 2022-12-09_07:51:04.859416) 07:51:07.976555 run osmo-hlr_10.42.42.2(pid=9744): stderr: | 20221209075105055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075105056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075105056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075105056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075105056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075105056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075105069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075105077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075105078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075105078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:08.048303 run osmo-msc_10.42.42.6(pid=9750): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9750)] 07:51:08.098437 run osmo-msc_10.42.42.6(pid=9750): stdout: | (launched: 2022-12-09_07:51:06.902775) 07:51:08.149476 run osmo-msc_10.42.42.6(pid=9750): stderr: | 20221209075107227 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075107227 DLGLOBAL DEBUG validating counter group 0x7f1defa6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075107227 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075107227 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075107228 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075107228 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075107230 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075107230 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075107230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075107230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:08.200825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9743): Terminating (SIGTERM) 07:51:08.241940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9746): Terminating (SIGTERM) 07:51:08.283441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9749): Terminating (SIGTERM) 07:51:08.325404 --- ParallelTerminationStrategy: PID 9743 died... 07:51:08.345424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9743): Terminated: ok {rc=0} 07:51:08.391599 --- ParallelTerminationStrategy: PID 9746 died... 07:51:08.411150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9746): Terminated: ok {rc=0} 07:51:08.457178 --- ParallelTerminationStrategy: PID 9749 died... 07:51:08.476641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9749): Terminated: ok {rc=0} 07:51:08.562682 bus /sierra_3: Setting Powered False 07:51:09.659972 bus /sierra_3: Setting Powered False 07:51:10.775291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 07:51:12.026986 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:51:12.032328 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:51:12.063443 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:51:12.091231 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 07:51:12.178522 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:51:12.208677 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:51:12.236354 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 07:51:12.825062 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 07:51:12.830172 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:12.841711 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:51:12.888596 tst emergency_mo_mt_call.py: using LAC 20006 07:51:13.013575 tst emergency_mo_mt_call.py: using RAC 116 07:51:13.133875 tst emergency_mo_mt_call.py: using CellId 20006 07:51:13.250669 tst emergency_mo_mt_call.py: using BVCI 20007 07:51:13.360679 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:13.371926 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:13.382870 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:13.394251 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:13.405646 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:13.416580 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:13.534864 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:13.650841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:14.114930 run create_hlr_db(pid=9755): Launched 07:51:14.230685 bus /sierra_2: Setting Powered False 07:51:15.290317 run create_hlr_db(pid=9755): Terminated: ok {rc=0} 07:51:15.730526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Launched 07:51:16.054691 run osmo-hlr_10.42.42.2(pid=9758): Launched 07:51:16.268019 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:16.856395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Launched 07:51:17.177636 run osmo-stp_10.42.42.5(pid=9761): Launched 07:51:17.391849 tst emergency_mo_mt_call.py: using MSISDN 7094 07:51:17.580794 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:18.159696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Launched 07:51:18.481331 run osmo-msc_10.42.42.6(pid=9764): Launched 07:51:18.661135 run osmo-stp_10.42.42.5(pid=9761): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] 07:51:18.795308 run osmo-stp_10.42.42.5(pid=9761): stdout: | (launched: 2022-12-09_07:51:17.118712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:18.930380 run osmo-stp_10.42.42.5(pid=9761): stderr: | 20221209075117400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075117400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075117400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075117401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075117401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075117401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075117401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:19.064558 run osmo-stp_10.42.42.5(pid=9761): stdout: | (launched: 2022-12-09_07:51:17.118712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:19.191455 run osmo-stp_10.42.42.5(pid=9761): stderr: | 20221209075117400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075117400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075117400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075117401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075117401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075117401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075117401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:19.344234 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9761): Process ended prematurely: osmo-stp_10.42.42.5(pid=9761) [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 07:51:19.353385 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 07:51:19.380854 run osmo-hlr_10.42.42.2(pid=9758): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9758)] 07:51:19.430775 run osmo-hlr_10.42.42.2(pid=9758): stdout: | (launched: 2022-12-09_07:51:15.997433) 07:51:19.482653 run osmo-hlr_10.42.42.2(pid=9758): stderr: | 20221209075116335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075116335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075116335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075116335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075116335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075116335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075116359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075116379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075116380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075116380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:19.555641 run osmo-msc_10.42.42.6(pid=9764): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9764)] 07:51:19.606033 run osmo-msc_10.42.42.6(pid=9764): stdout: | (launched: 2022-12-09_07:51:18.422073) 07:51:19.657850 run osmo-msc_10.42.42.6(pid=9764): stderr: | 20221209075118744 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075118744 DLGLOBAL DEBUG validating counter group 0x7f63ad63bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075118744 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075118744 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075118745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075118745 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075118747 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075118747 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075118747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075118747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:19.710026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Terminating (SIGTERM) 07:51:19.751803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Terminating (SIGTERM) 07:51:19.793712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Terminating (SIGTERM) 07:51:19.835916 --- ParallelTerminationStrategy: PID 9757 died... 07:51:19.856025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Terminated: ok {rc=0} 07:51:19.902357 --- ParallelTerminationStrategy: PID 9760 died... 07:51:19.921974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Terminated: ok {rc=0} 07:51:19.968038 --- ParallelTerminationStrategy: PID 9763 died... 07:51:19.987743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Terminated: ok {rc=0} 07:51:20.075546 bus /sierra_3: Setting Powered False 07:51:21.175652 bus /sierra_3: Setting Powered False 07:51:22.293409 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 07:51:23.381549 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:23.393851 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:51:23.442453 tst emergency_preemptive_call.py: using LAC 20007 07:51:23.569599 tst emergency_preemptive_call.py: using RAC 117 07:51:23.695065 tst emergency_preemptive_call.py: using CellId 20007 07:51:23.821833 tst emergency_preemptive_call.py: using BVCI 20008 07:51:23.937299 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:23.948697 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:23.959991 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:23.971163 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:23.982420 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:51:23.993650 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:24.110756 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:24.224575 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:24.346334 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:24.465873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:24.965391 run create_hlr_db(pid=9766): Launched 07:51:25.097140 bus /sierra_2: Setting Powered False 07:51:26.160433 run create_hlr_db(pid=9766): Terminated: ok {rc=0} 07:51:26.588851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9768): Launched 07:51:26.887346 run osmo-hlr_10.42.42.2(pid=9769): Launched 07:51:27.001071 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:27.527972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9771): Launched 07:51:27.827142 run osmo-stp_10.42.42.5(pid=9772): Launched 07:51:27.950743 tst emergency_preemptive_call.py: using MSISDN 7095 07:51:28.102233 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:28.636555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9774): Launched 07:51:28.936405 run osmo-msc_10.42.42.6(pid=9775): Launched 07:51:29.103829 run osmo-stp_10.42.42.5(pid=9772): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9772)] 07:51:29.229537 run osmo-stp_10.42.42.5(pid=9772): stdout: | (launched: 2022-12-09_07:51:27.771354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:29.356613 run osmo-stp_10.42.42.5(pid=9772): stderr: | 20221209075127942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075127942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075127942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075127943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075127944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075127944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075127944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:29.480906 run osmo-stp_10.42.42.5(pid=9772): stdout: | (launched: 2022-12-09_07:51:27.771354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:29.599437 run osmo-stp_10.42.42.5(pid=9772): stderr: | 20221209075127942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075127942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075127942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075127943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075127944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075127944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075127944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:29.741357 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9772): Process ended prematurely: osmo-stp_10.42.42.5(pid=9772) [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9772)] [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 07:51:29.749972 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:51:29.776823 run osmo-hlr_10.42.42.2(pid=9769): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9769)] 07:51:29.824389 run osmo-hlr_10.42.42.2(pid=9769): stdout: | (launched: 2022-12-09_07:51:26.831784) 07:51:29.873612 run osmo-hlr_10.42.42.2(pid=9769): stderr: | 20221209075127004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075127004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075127004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075127004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075127004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075127004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075127016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075127024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075127025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075127025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:29.942254 run osmo-msc_10.42.42.6(pid=9775): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9775)] 07:51:29.989942 run osmo-msc_10.42.42.6(pid=9775): stdout: | (launched: 2022-12-09_07:51:28.880591) 07:51:30.038934 run osmo-msc_10.42.42.6(pid=9775): stderr: | 20221209075129153 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075129154 DLGLOBAL DEBUG validating counter group 0x7f7e14f64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075129154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075129154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075129154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075129154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075129156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075129157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075129158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075129158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:30.088450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9768): Terminating (SIGTERM) 07:51:30.127855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9771): Terminating (SIGTERM) 07:51:30.167226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9774): Terminating (SIGTERM) 07:51:30.206974 --- ParallelTerminationStrategy: PID 9768 died... 07:51:30.225973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9768): Terminated: ok {rc=0} 07:51:30.270484 --- ParallelTerminationStrategy: PID 9771 died... 07:51:30.289207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9771): Terminated: ok {rc=0} 07:51:30.333628 --- ParallelTerminationStrategy: PID 9774 died... 07:51:30.352137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9774): Terminated: ok {rc=0} 07:51:30.438124 bus /sierra_9: Setting Powered False 07:51:31.534716 bus /sierra_9: Setting Powered False 07:51:32.647530 bus /sierra_8: Setting Powered False 07:51:33.745126 bus /sierra_8: Setting Powered False 07:51:34.859837 bus /sierra_3: Setting Powered False 07:51:35.957768 bus /sierra_3: Setting Powered False 07:51:37.077501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 07:51:38.359031 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:51:38.363863 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:51:38.394330 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 07:51:38.434912 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 07:51:38.525213 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:51:38.555877 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 07:51:38.596135 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 07:51:39.191481 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 07:51:39.244290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.255781 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:51:39.302724 tst cs_paging_gprs_active.py: using LAC 20008 07:51:39.431198 tst cs_paging_gprs_active.py: using RAC 118 07:51:39.563053 tst cs_paging_gprs_active.py: using CellId 20008 07:51:39.684298 tst cs_paging_gprs_active.py: using BVCI 20009 07:51:39.796134 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.807271 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.818321 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.829648 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.840813 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.851915 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.863260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.874209 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:39.885474 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:40.006009 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:40.122411 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:51:40.327776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:40.634636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9781): Launched 07:51:40.901810 run iperf3-srv_10.42.42.10(pid=9782): Launched 07:51:41.015222 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:51:41.218598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:41.523284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9783): Launched 07:51:41.788283 run iperf3-srv_10.42.42.10(pid=9784): Launched 07:51:41.902006 tst cs_paging_gprs_active.py:38: start network... 07:51:42.105425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:42.575773 run create_hlr_db(pid=9785): Launched 07:51:42.691831 bus /sierra_2: Setting Powered False 07:51:43.752192 run create_hlr_db(pid=9785): Terminated: ok {rc=0} 07:51:44.198654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Launched 07:51:44.526062 run osmo-hlr_10.42.42.2(pid=9788): Launched 07:51:44.651860 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:45.213166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Launched 07:51:45.540853 run osmo-stp_10.42.42.5(pid=9791): Launched 07:51:45.665111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:46.233202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Launched 07:51:46.371177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:46.654448 run patchelf(pid=9794): Launched 07:51:46.859074 run osmo-stp_10.42.42.5(pid=9791): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] 07:51:47.000541 run osmo-stp_10.42.42.5(pid=9791): stdout: | (launched: 2022-12-09_07:51:45.480401) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:47.142965 run osmo-stp_10.42.42.5(pid=9791): stderr: | 20221209075145672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075145672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075145672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075145673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075145673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075145673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075145673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:47.283984 run osmo-stp_10.42.42.5(pid=9791): stdout: | (launched: 2022-12-09_07:51:45.480401) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:47.418062 run osmo-stp_10.42.42.5(pid=9791): stderr: | 20221209075145672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075145672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075145672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075145673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075145673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075145673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075145673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:47.576412 run patchelf(pid=9794): Terminating (SIGINT) 07:51:47.758881 run patchelf(pid=9794): Terminated: ok {rc=0} 07:51:47.890045 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9791): Process ended prematurely: osmo-stp_10.42.42.5(pid=9791) [trial-2356↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] [trial-2356↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 07:51:47.900334 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:51:47.929109 run osmo-hlr_10.42.42.2(pid=9788): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9788)] 07:51:47.978969 run osmo-hlr_10.42.42.2(pid=9788): stdout: | (launched: 2022-12-09_07:51:44.465710) 07:51:48.030742 run osmo-hlr_10.42.42.2(pid=9788): stderr: | 20221209075144663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075144663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075144663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075144663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075144663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075144663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075144677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075144685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075144685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075144685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:48.083084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9781): Terminating (SIGTERM) 07:51:48.124874 run iperf3-srv_10.42.42.10(pid=9782): Terminating (SIGTERM) 07:51:48.166613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9783): Terminating (SIGTERM) 07:51:48.208269 run iperf3-srv_10.42.42.10(pid=9784): Terminating (SIGTERM) 07:51:48.250068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Terminating (SIGTERM) 07:51:48.292276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Terminating (SIGTERM) 07:51:48.334352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Terminating (SIGTERM) 07:51:48.376628 --- ParallelTerminationStrategy: PID 9781 died... 07:51:48.396718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9781): Terminated: ok {rc=0} 07:51:48.443101 --- ParallelTerminationStrategy: PID 9782 died... 07:51:48.462770 run iperf3-srv_10.42.42.10(pid=9782): Terminated {rc=256} 07:51:48.508769 --- ParallelTerminationStrategy: PID 9783 died... 07:51:48.528781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9783): Terminated: ok {rc=0} 07:51:48.574745 --- ParallelTerminationStrategy: PID 9784 died... 07:51:48.594345 run iperf3-srv_10.42.42.10(pid=9784): Terminated {rc=256} 07:51:48.640158 --- ParallelTerminationStrategy: PID 9787 died... 07:51:48.659824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Terminated: ok {rc=0} 07:51:48.705706 --- ParallelTerminationStrategy: PID 9790 died... 07:51:48.725374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Terminated: ok {rc=0} 07:51:48.771149 --- ParallelTerminationStrategy: PID 9793 died... 07:51:48.790784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Terminated: ok {rc=0} 07:51:48.877418 bus /gobi_0: Setting Powered False 07:51:49.977100 bus /gobi_0: Setting Powered False 07:51:51.091625 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 07:51:52.241460 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.253693 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:51:52.307658 tst iperf3.py: using LAC 20009 07:51:52.435140 tst iperf3.py: using RAC 119 07:51:52.562281 tst iperf3.py: using CellId 20009 07:51:52.681130 tst iperf3.py: using BVCI 20010 07:51:52.791086 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.802243 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.813137 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.824310 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.835247 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.846196 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.857244 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.868008 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:51:52.879109 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:51:52.998983 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:51:53.220321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:53.549229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Launched 07:51:53.834357 run iperf3-srv_10.42.42.10(pid=9796): Launched 07:51:53.955524 tst iperf3.py:8: start network... 07:51:54.174999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:54.679900 run create_hlr_db(pid=9797): Launched 07:51:54.812507 bus /gobi_6: Setting Powered False 07:51:55.875757 run create_hlr_db(pid=9797): Terminated: ok {rc=0} 07:51:56.309396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9799): Launched 07:51:56.612578 run osmo-hlr_10.42.42.2(pid=9800): Launched 07:51:56.727597 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:57.261146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9802): Launched 07:51:57.566850 run osmo-stp_10.42.42.5(pid=9803): Launched 07:51:57.683113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:58.207076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9805): Launched 07:51:58.324250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:58.582357 run patchelf(pid=9806): Launched 07:51:58.752099 run osmo-stp_10.42.42.5(pid=9803): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9803)] 07:51:58.880345 run osmo-stp_10.42.42.5(pid=9803): stdout: | (launched: 2022-12-09_07:51:57.510397) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:59.010127 run osmo-stp_10.42.42.5(pid=9803): stderr: | 20221209075157680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075157680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075157680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075157681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075157681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075157681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075157681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:59.140151 run osmo-stp_10.42.42.5(pid=9803): stdout: | (launched: 2022-12-09_07:51:57.510397) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:59.264525 run osmo-stp_10.42.42.5(pid=9803): stderr: | 20221209075157680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075157680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075157680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075157681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075157681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075157681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075157681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:59.411704 run patchelf(pid=9806): Terminating (SIGINT) 07:51:59.581081 run patchelf(pid=9806): Terminated: ok {rc=0} 07:51:59.703167 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9803): Process ended prematurely: osmo-stp_10.42.42.5(pid=9803) [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9803)] [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 07:51:59.712710 tst iperf3.py:8: Test FAILED (7.5 sec) 07:51:59.740434 run osmo-hlr_10.42.42.2(pid=9800): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9800)] 07:51:59.788312 run osmo-hlr_10.42.42.2(pid=9800): stdout: | (launched: 2022-12-09_07:51:56.556176) 07:51:59.838221 run osmo-hlr_10.42.42.2(pid=9800): stderr: | 20221209075156731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075156731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075156731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075156731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075156731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075156732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075156744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075156753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075156753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075156753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:59.888273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Terminating (SIGTERM) 07:51:59.928279 run iperf3-srv_10.42.42.10(pid=9796): Terminating (SIGTERM) 07:51:59.968164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9799): Terminating (SIGTERM) 07:52:00.008125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9802): Terminating (SIGTERM) 07:52:00.048295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9805): Terminating (SIGTERM) 07:52:00.088601 --- ParallelTerminationStrategy: PID 9795 died... 07:52:00.107974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Terminated: ok {rc=0} 07:52:00.152816 --- ParallelTerminationStrategy: PID 9796 died... 07:52:00.172009 run iperf3-srv_10.42.42.10(pid=9796): Terminated {rc=256} 07:52:00.216664 --- ParallelTerminationStrategy: PID 9799 died... 07:52:00.235607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9799): Terminated: ok {rc=0} 07:52:00.280888 --- ParallelTerminationStrategy: PID 9802 died... 07:52:00.299874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9802): Terminated: ok {rc=0} 07:52:00.344343 --- ParallelTerminationStrategy: PID 9805 died... 07:52:00.363420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9805): Terminated: ok {rc=0} 07:52:00.447252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 07:52:01.596028 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:01.608764 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:52:01.660201 tst iperf3m4.py: using LAC 20010 07:52:01.781396 tst iperf3m4.py: using RAC 120 07:52:01.926666 tst iperf3m4.py: using CellId 20010 07:52:02.065399 tst iperf3m4.py: using BVCI 20011 07:52:02.184872 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.196425 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.208207 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.219808 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.231405 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.242928 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.254760 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.266403 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:02.279161 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:52:02.401657 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:52:02.524541 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:52:02.640661 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:52:02.765340 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:52:02.986645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:03.314971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9807): Launched 07:52:03.598908 run iperf3-srv_10.42.42.10(pid=9808): Launched 07:52:03.722713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:52:03.944074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:04.271495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9809): Launched 07:52:04.556391 run iperf3-srv_10.42.42.10(pid=9810): Launched 07:52:04.679177 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:52:04.898436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:05.225070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9811): Launched 07:52:05.508288 run iperf3-srv_10.42.42.10(pid=9812): Launched 07:52:05.631146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:52:05.850331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:06.178236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9813): Launched 07:52:06.462923 run iperf3-srv_10.42.42.10(pid=9814): Launched 07:52:06.585447 tst iperf3m4.py:8: start network... 07:52:06.804367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:07.311983 run create_hlr_db(pid=9815): Launched 07:52:07.435941 bus /gobi_6: Setting Powered False 07:52:08.497506 run create_hlr_db(pid=9815): Terminated: ok {rc=0} 07:52:08.942045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9817): Launched 07:52:09.268694 run osmo-hlr_10.42.42.2(pid=9818): Launched 07:52:09.394072 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:10.063086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9820): Launched 07:52:10.381843 run osmo-stp_10.42.42.5(pid=9821): Launched 07:52:10.501642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:11.050964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9823): Launched 07:52:11.173365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:11.443347 run patchelf(pid=9824): Launched 07:52:11.619075 run osmo-stp_10.42.42.5(pid=9821): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9821)] 07:52:11.753114 run osmo-stp_10.42.42.5(pid=9821): stdout: | (launched: 2022-12-09_07:52:10.322553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:11.889150 run osmo-stp_10.42.42.5(pid=9821): stderr: | 20221209075210513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075210513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075210514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075210514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075210514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075210515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075210515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:12.025233 run osmo-stp_10.42.42.5(pid=9821): stdout: | (launched: 2022-12-09_07:52:10.322553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:12.154922 run osmo-stp_10.42.42.5(pid=9821): stderr: | 20221209075210513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075210513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075210514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075210514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075210514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075210515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075210515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:12.309014 run patchelf(pid=9824): Terminating (SIGINT) 07:52:12.486206 run patchelf(pid=9824): Terminated: ok {rc=0} 07:52:12.613650 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9821): Process ended prematurely: osmo-stp_10.42.42.5(pid=9821) [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9821)] [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 07:52:12.623923 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:52:12.652705 run osmo-hlr_10.42.42.2(pid=9818): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9818)] 07:52:12.703149 run osmo-hlr_10.42.42.2(pid=9818): stdout: | (launched: 2022-12-09_07:52:09.208286) 07:52:12.754871 run osmo-hlr_10.42.42.2(pid=9818): stderr: | 20221209075209405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075209405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075209405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075209405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075209405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075209405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075209417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075209426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075209426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075209426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:12.806855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9807): Terminating (SIGTERM) 07:52:12.848138 run iperf3-srv_10.42.42.10(pid=9808): Terminating (SIGTERM) 07:52:12.889682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9809): Terminating (SIGTERM) 07:52:12.931388 run iperf3-srv_10.42.42.10(pid=9810): Terminating (SIGTERM) 07:52:12.972761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9811): Terminating (SIGTERM) 07:52:13.014797 run iperf3-srv_10.42.42.10(pid=9812): Terminating (SIGTERM) 07:52:13.056201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9813): Terminating (SIGTERM) 07:52:13.097946 run iperf3-srv_10.42.42.10(pid=9814): Terminating (SIGTERM) 07:52:13.139443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9817): Terminating (SIGTERM) 07:52:13.181126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9820): Terminating (SIGTERM) 07:52:13.222765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9823): Terminating (SIGTERM) 07:52:13.264688 --- ParallelTerminationStrategy: PID 9807 died... 07:52:13.285063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9807): Terminated: ok {rc=0} 07:52:13.331265 --- ParallelTerminationStrategy: PID 9808 died... 07:52:13.350916 run iperf3-srv_10.42.42.10(pid=9808): Terminated {rc=256} 07:52:13.396586 --- ParallelTerminationStrategy: PID 9809 died... 07:52:13.416172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9809): Terminated: ok {rc=0} 07:52:13.462009 --- ParallelTerminationStrategy: PID 9810 died... 07:52:13.481648 run iperf3-srv_10.42.42.10(pid=9810): Terminated {rc=256} 07:52:13.527220 --- ParallelTerminationStrategy: PID 9811 died... 07:52:13.546989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9811): Terminated: ok {rc=0} 07:52:13.592530 --- ParallelTerminationStrategy: PID 9812 died... 07:52:13.612250 run iperf3-srv_10.42.42.10(pid=9812): Terminated {rc=256} 07:52:13.658493 --- ParallelTerminationStrategy: PID 9813 died... 07:52:13.678162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9813): Terminated: ok {rc=0} 07:52:13.723836 --- ParallelTerminationStrategy: PID 9814 died... 07:52:13.743446 run iperf3-srv_10.42.42.10(pid=9814): Terminated {rc=256} 07:52:13.789244 --- ParallelTerminationStrategy: PID 9817 died... 07:52:13.809021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9817): Terminated: ok {rc=0} 07:52:13.854398 --- ParallelTerminationStrategy: PID 9820 died... 07:52:13.873739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9820): Terminated: ok {rc=0} 07:52:13.919374 --- ParallelTerminationStrategy: PID 9823 died... 07:52:13.939120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9823): Terminated: ok {rc=0} 07:52:14.026756 bus /gobi_4: Setting Powered False 07:52:15.125125 bus /gobi_4: Setting Powered False 07:52:16.254906 bus /gobi_1: Setting Powered False 07:52:17.367995 bus /gobi_1: Setting Powered False 07:52:18.483444 bus /gobi_0: Setting Powered False 07:52:19.579729 bus /gobi_0: Setting Powered False 07:52:20.694044 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 07:52:21.796588 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:21.808693 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:52:21.855475 tst ping.py: using LAC 20011 07:52:21.978296 tst ping.py: using RAC 121 07:52:22.104043 tst ping.py: using CellId 20011 07:52:22.226283 tst ping.py: using BVCI 20012 07:52:22.339580 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.350958 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.362190 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.373304 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.384330 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.395321 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.406442 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:22.417568 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:52:22.530886 tst ping.py:19: start network... 07:52:22.726948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:23.182027 run create_hlr_db(pid=9825): Launched 07:52:23.296190 bus /gobi_6: Setting Powered False 07:52:24.355216 run create_hlr_db(pid=9825): Terminated: ok {rc=0} 07:52:24.765433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9827): Launched 07:52:25.057732 run osmo-hlr_10.42.42.2(pid=9828): Launched 07:52:25.169767 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:25.690204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9830): Launched 07:52:25.983476 run osmo-stp_10.42.42.5(pid=9831): Launched 07:52:26.095392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:26.600213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9833): Launched 07:52:26.711425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:26.958997 run patchelf(pid=9834): Launched 07:52:27.121709 run osmo-stp_10.42.42.5(pid=9831): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9831)] 07:52:27.245156 run osmo-stp_10.42.42.5(pid=9831): stdout: | (launched: 2022-12-09_07:52:25.928806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:27.370261 run osmo-stp_10.42.42.5(pid=9831): stderr: | 20221209075226098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075226098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075226098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075226099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075226099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075226099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075226099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:27.495575 run osmo-stp_10.42.42.5(pid=9831): stdout: | (launched: 2022-12-09_07:52:25.928806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:27.615406 run osmo-stp_10.42.42.5(pid=9831): stderr: | 20221209075226098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075226098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075226098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075226099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075226099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075226099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075226099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:27.757280 run patchelf(pid=9834): Terminating (SIGINT) 07:52:27.921431 run patchelf(pid=9834): Terminated: ok {rc=0} 07:52:28.039154 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9831): Process ended prematurely: osmo-stp_10.42.42.5(pid=9831) [trial-2356↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9831)] [trial-2356↪gprs:trx-lms-limenet-micro↪ping.py:22] 07:52:28.048374 tst ping.py:22: Test FAILED (6.2 sec) 07:52:28.075421 run osmo-hlr_10.42.42.2(pid=9828): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9828)] 07:52:28.123285 run osmo-hlr_10.42.42.2(pid=9828): stdout: | (launched: 2022-12-09_07:52:25.003377) 07:52:28.173119 run osmo-hlr_10.42.42.2(pid=9828): stderr: | 20221209075225176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075225176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075225176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075225176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075225177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075225177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075225189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075225198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075225198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075225198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:28.222914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9827): Terminating (SIGTERM) 07:52:28.262325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9830): Terminating (SIGTERM) 07:52:28.301813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9833): Terminating (SIGTERM) 07:52:28.341464 --- ParallelTerminationStrategy: PID 9827 died... 07:52:28.360234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9827): Terminated: ok {rc=0} 07:52:28.404298 --- ParallelTerminationStrategy: PID 9830 died... 07:52:28.422583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9830): Terminated: ok {rc=0} 07:52:28.466239 --- ParallelTerminationStrategy: PID 9833 died... 07:52:28.484633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9833): Terminated: ok {rc=0} 07:52:28.570483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 07:52:29.657914 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:29.669948 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:52:29.721896 tst ping_idle_ping.py: using LAC 20012 07:52:29.836534 tst ping_idle_ping.py: using RAC 122 07:52:29.950319 tst ping_idle_ping.py: using CellId 20012 07:52:30.063396 tst ping_idle_ping.py: using BVCI 20013 07:52:30.170174 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.181191 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.191877 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.202878 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.213739 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.224517 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.235597 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:52:30.246520 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:52:30.360584 tst ping_idle_ping.py:24: start network... 07:52:30.556942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:31.032063 run create_hlr_db(pid=9835): Launched 07:52:31.188419 bus /gobi_6: Setting Powered False 07:52:32.258172 run create_hlr_db(pid=9835): Terminated: ok {rc=0} 07:52:32.691330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9837): Launched 07:52:33.005699 run osmo-hlr_10.42.42.2(pid=9838): Launched 07:52:33.125059 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:33.674074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9840): Launched 07:52:33.987508 run osmo-stp_10.42.42.5(pid=9841): Launched 07:52:34.109309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:34.652605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9843): Launched 07:52:34.772284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:35.038173 run patchelf(pid=9844): Launched 07:52:35.212130 run osmo-stp_10.42.42.5(pid=9841): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9841)] 07:52:35.345714 run osmo-stp_10.42.42.5(pid=9841): stdout: | (launched: 2022-12-09_07:52:33.929454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:35.480055 run osmo-stp_10.42.42.5(pid=9841): stderr: | 20221209075234119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075234119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075234120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075234120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075234121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075234121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075234121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:35.614721 run osmo-stp_10.42.42.5(pid=9841): stdout: | (launched: 2022-12-09_07:52:33.929454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:35.743671 run osmo-stp_10.42.42.5(pid=9841): stderr: | 20221209075234119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075234119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075234120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075234120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075234121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075234121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075234121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:35.897119 run patchelf(pid=9844): Terminating (SIGINT) 07:52:36.071432 run patchelf(pid=9844): Terminated: ok {rc=0} 07:52:36.197797 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9841): Process ended prematurely: osmo-stp_10.42.42.5(pid=9841) [trial-2356↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9841)] [trial-2356↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 07:52:36.207451 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:52:36.235241 run osmo-hlr_10.42.42.2(pid=9838): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9838)] 07:52:36.284615 run osmo-hlr_10.42.42.2(pid=9838): stdout: | (launched: 2022-12-09_07:52:32.946701) 07:52:36.336120 run osmo-hlr_10.42.42.2(pid=9838): stderr: | 20221209075233143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075233143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075233143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075233143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075233143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075233143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075233155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075233163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075233164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075233164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:36.387801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9837): Terminating (SIGTERM) 07:52:36.429025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9840): Terminating (SIGTERM) 07:52:36.470071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9843): Terminating (SIGTERM) 07:52:36.511601 --- ParallelTerminationStrategy: PID 9837 died... 07:52:36.531349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9837): Terminated: ok {rc=0} 07:52:36.576634 --- ParallelTerminationStrategy: PID 9840 died... 07:52:36.595887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9840): Terminated: ok {rc=0} 07:52:36.640939 --- ParallelTerminationStrategy: PID 9843 died... 07:52:36.660256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9843): Terminated: ok {rc=0} 07:52:36.746638 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 07:52:38.043619 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:52:38.048807 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:52:38.080800 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:52:38.120603 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:52:38.208746 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:52:38.238669 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:52:38.277906 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:52:38.874311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:52:38.923837 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:38.935162 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:52:38.982241 tst cs_paging_gprs_active.py: using LAC 20013 07:52:39.099873 tst cs_paging_gprs_active.py: using RAC 123 07:52:39.217359 tst cs_paging_gprs_active.py: using CellId 20013 07:52:39.334662 tst cs_paging_gprs_active.py: using BVCI 20014 07:52:39.445545 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.456643 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.467609 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.479147 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.490910 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.502775 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.514592 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.526303 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:39.538260 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:52:39.660126 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:52:39.778651 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:52:39.981324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:40.284291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9850): Launched 07:52:40.546521 run iperf3-srv_10.42.42.10(pid=9851): Launched 07:52:40.661424 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:52:40.861911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:41.164566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9852): Launched 07:52:41.426237 run iperf3-srv_10.42.42.10(pid=9853): Launched 07:52:41.538573 tst cs_paging_gprs_active.py:38: start network... 07:52:41.738926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:42.206425 run create_hlr_db(pid=9854): Launched 07:52:42.322704 bus /gobi_6: Setting Powered False 07:52:43.382332 run create_hlr_db(pid=9854): Terminated: ok {rc=0} 07:52:43.801596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9856): Launched 07:52:44.101447 run osmo-hlr_10.42.42.2(pid=9857): Launched 07:52:44.215191 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:44.747416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9859): Launched 07:52:45.047298 run osmo-stp_10.42.42.5(pid=9860): Launched 07:52:45.161534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:45.681545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9862): Launched 07:52:45.795426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:46.068433 run patchelf(pid=9863): Launched 07:52:46.269473 run osmo-stp_10.42.42.5(pid=9860): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9860)] 07:52:46.438181 run osmo-stp_10.42.42.5(pid=9860): stdout: | (launched: 2022-12-09_07:52:44.991602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:46.579469 run osmo-stp_10.42.42.5(pid=9860): stderr: | 20221209075245159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075245159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075245159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075245159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075245160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075245160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075245160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:46.721153 run osmo-stp_10.42.42.5(pid=9860): stdout: | (launched: 2022-12-09_07:52:44.991602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:46.855070 run osmo-stp_10.42.42.5(pid=9860): stderr: | 20221209075245159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075245159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075245159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075245159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075245160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075245160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075245160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:47.015762 run patchelf(pid=9863): Terminating (SIGINT) 07:52:47.198776 run patchelf(pid=9863): Terminated: ok {rc=0} 07:52:47.328250 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9860): Process ended prematurely: osmo-stp_10.42.42.5(pid=9860) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9860)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:52:47.338929 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:52:47.367984 run osmo-hlr_10.42.42.2(pid=9857): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9857)] 07:52:47.418156 run osmo-hlr_10.42.42.2(pid=9857): stdout: | (launched: 2022-12-09_07:52:44.045626) 07:52:47.469949 run osmo-hlr_10.42.42.2(pid=9857): stderr: | 20221209075244220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075244220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075244220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075244220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075244221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075244221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075244232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075244241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075244241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075244242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:47.523598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9850): Terminating (SIGTERM) 07:52:47.564207 run iperf3-srv_10.42.42.10(pid=9851): Terminating (SIGTERM) 07:52:47.604753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9852): Terminating (SIGTERM) 07:52:47.645117 run iperf3-srv_10.42.42.10(pid=9853): Terminating (SIGTERM) 07:52:47.685442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9856): Terminating (SIGTERM) 07:52:47.726198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9859): Terminating (SIGTERM) 07:52:47.765809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9862): Terminating (SIGTERM) 07:52:47.807183 --- ParallelTerminationStrategy: PID 9850 died... 07:52:47.826224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9850): Terminated: ok {rc=0} 07:52:47.871625 --- ParallelTerminationStrategy: PID 9851 died... 07:52:47.890207 run iperf3-srv_10.42.42.10(pid=9851): Terminated {rc=256} 07:52:47.935483 --- ParallelTerminationStrategy: PID 9852 died... 07:52:47.954341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9852): Terminated: ok {rc=0} 07:52:47.999752 --- ParallelTerminationStrategy: PID 9853 died... 07:52:48.018454 run iperf3-srv_10.42.42.10(pid=9853): Terminated {rc=256} 07:52:48.064172 --- ParallelTerminationStrategy: PID 9856 died... 07:52:48.083045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9856): Terminated: ok {rc=0} 07:52:48.128513 --- ParallelTerminationStrategy: PID 9859 died... 07:52:48.147297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9859): Terminated: ok {rc=0} 07:52:48.193252 --- ParallelTerminationStrategy: PID 9862 died... 07:52:48.212286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9862): Terminated: ok {rc=0} 07:52:48.298816 bus /gobi_0: Setting Powered False 07:52:49.398368 bus /gobi_0: Setting Powered False 07:52:50.514256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:52:51.665420 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:51.677681 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:52:51.726462 tst iperf3.py: using LAC 20014 07:52:51.853085 tst iperf3.py: using RAC 124 07:52:51.981038 tst iperf3.py: using CellId 20014 07:52:52.105053 tst iperf3.py: using BVCI 20015 07:52:52.220881 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.232716 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.244135 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.255577 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.267387 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.279008 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.290606 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.302506 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:52:52.314360 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:52:52.431129 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:52:52.632925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:52.934514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9864): Launched 07:52:53.197903 run iperf3-srv_10.42.42.10(pid=9865): Launched 07:52:53.309781 tst iperf3.py:8: start network... 07:52:53.510322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:53.973609 run create_hlr_db(pid=9866): Launched 07:52:54.088712 bus /gobi_6: Setting Powered False 07:52:55.148705 run create_hlr_db(pid=9866): Terminated: ok {rc=0} 07:52:55.587027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9868): Launched 07:52:55.907448 run osmo-hlr_10.42.42.2(pid=9869): Launched 07:52:56.030516 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:56.579884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9871): Launched 07:52:56.900459 run osmo-stp_10.42.42.5(pid=9872): Launched 07:52:57.021231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:57.571893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9874): Launched 07:52:57.693664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:57.963849 run patchelf(pid=9875): Launched 07:52:58.141619 run osmo-stp_10.42.42.5(pid=9872): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9872)] 07:52:58.276310 run osmo-stp_10.42.42.5(pid=9872): stdout: | (launched: 2022-12-09_07:52:56.841076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:58.413761 run osmo-stp_10.42.42.5(pid=9872): stderr: | 20221209075257030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075257030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075257031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075257031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075257032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075257032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075257032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:58.550269 run osmo-stp_10.42.42.5(pid=9872): stdout: | (launched: 2022-12-09_07:52:56.841076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:58.681280 run osmo-stp_10.42.42.5(pid=9872): stderr: | 20221209075257030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075257030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075257031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075257031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075257032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075257032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075257032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:58.836362 run patchelf(pid=9875): Terminating (SIGINT) 07:52:59.014445 run patchelf(pid=9875): Terminated: ok {rc=0} 07:52:59.142913 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9872): Process ended prematurely: osmo-stp_10.42.42.5(pid=9872) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9872)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 07:52:59.153220 tst iperf3.py:8: Test FAILED (7.5 sec) 07:52:59.181744 run osmo-hlr_10.42.42.2(pid=9869): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9869)] 07:52:59.231961 run osmo-hlr_10.42.42.2(pid=9869): stdout: | (launched: 2022-12-09_07:52:55.848471) 07:52:59.283985 run osmo-hlr_10.42.42.2(pid=9869): stderr: | 20221209075256046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075256046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075256046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075256046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075256046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075256046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075256058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075256066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075256066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075256066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:59.336815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9864): Terminating (SIGTERM) 07:52:59.379425 run iperf3-srv_10.42.42.10(pid=9865): Terminating (SIGTERM) 07:52:59.421575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9868): Terminating (SIGTERM) 07:52:59.463623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9871): Terminating (SIGTERM) 07:52:59.505599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9874): Terminating (SIGTERM) 07:52:59.547763 --- ParallelTerminationStrategy: PID 9864 died... 07:52:59.567639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9864): Terminated: ok {rc=0} 07:52:59.613986 --- ParallelTerminationStrategy: PID 9865 died... 07:52:59.633463 run iperf3-srv_10.42.42.10(pid=9865): Terminated {rc=256} 07:52:59.679557 --- ParallelTerminationStrategy: PID 9868 died... 07:52:59.699052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9868): Terminated: ok {rc=0} 07:52:59.745105 --- ParallelTerminationStrategy: PID 9871 died... 07:52:59.764609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9871): Terminated: ok {rc=0} 07:52:59.810724 --- ParallelTerminationStrategy: PID 9874 died... 07:52:59.830379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9874): Terminated: ok {rc=0} 07:52:59.918457 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:53:01.069869 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.083461 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:53:01.131331 tst iperf3m4.py: using LAC 20015 07:53:01.289194 tst iperf3m4.py: using RAC 125 07:53:01.455834 tst iperf3m4.py: using CellId 20015 07:53:01.619850 tst iperf3m4.py: using BVCI 20016 07:53:01.780407 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.796094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.808599 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.820879 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.834849 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.853559 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.870160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.892497 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:01.908821 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:53:02.066854 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:53:02.232271 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:53:02.366479 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:53:02.514571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:53:02.773058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:03.164085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9949): Launched 07:53:03.488135 run iperf3-srv_10.42.42.10(pid=9977): Launched 07:53:03.657647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:53:03.911281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:04.290594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10082): Launched 07:53:04.624600 run iperf3-srv_10.42.42.10(pid=10128): Launched 07:53:04.794748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:53:05.019102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:05.333530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10149): Launched 07:53:05.629348 run iperf3-srv_10.42.42.10(pid=10150): Launched 07:53:05.764168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:53:05.983618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:06.311576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10151): Launched 07:53:06.607255 run iperf3-srv_10.42.42.10(pid=10153): Launched 07:53:06.729325 tst iperf3m4.py:8: start network... 07:53:06.947359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:07.453996 run create_hlr_db(pid=10155): Launched 07:53:07.613541 bus /gobi_6: Setting Powered False 07:53:08.675621 run create_hlr_db(pid=10155): Terminated: ok {rc=0} 07:53:09.101975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Launched 07:53:09.421148 run osmo-hlr_10.42.42.2(pid=10158): Launched 07:53:09.667083 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:10.325994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Launched 07:53:10.665781 run osmo-stp_10.42.42.5(pid=10161): Launched 07:53:10.907519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:11.554942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10163): Launched 07:53:11.689925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:11.969373 run patchelf(pid=10164): Launched 07:53:12.162753 run osmo-stp_10.42.42.5(pid=10161): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] 07:53:12.301666 run osmo-stp_10.42.42.5(pid=10161): stdout: | (launched: 2022-12-09_07:53:10.603317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:12.443248 run osmo-stp_10.42.42.5(pid=10161): stderr: | 20221209075310892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075310892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075310892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075310893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075310893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075310893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075310893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:12.583695 run osmo-stp_10.42.42.5(pid=10161): stdout: | (launched: 2022-12-09_07:53:10.603317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:12.718156 run osmo-stp_10.42.42.5(pid=10161): stderr: | 20221209075310892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075310892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075310892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075310893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075310893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075310893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075310893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:12.877459 run patchelf(pid=10164): Terminating (SIGINT) 07:53:13.060081 run patchelf(pid=10164): Terminated: ok {rc=0} 07:53:13.191895 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10161): Process ended prematurely: osmo-stp_10.42.42.5(pid=10161) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 07:53:13.203644 tst iperf3m4.py:8: Test FAILED (12.2 sec) 07:53:13.234338 run osmo-hlr_10.42.42.2(pid=10158): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10158)] 07:53:13.286655 run osmo-hlr_10.42.42.2(pid=10158): stdout: | (launched: 2022-12-09_07:53:09.364407) 07:53:13.340708 run osmo-hlr_10.42.42.2(pid=10158): stderr: | 20221209075309662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075309662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075309662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075309662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075309662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075309662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075309679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075309696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075309696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075309696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:13.394686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9949): Terminating (SIGTERM) 07:53:13.438296 run iperf3-srv_10.42.42.10(pid=9977): Terminating (SIGTERM) 07:53:13.483233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10082): Terminating (SIGTERM) 07:53:13.527152 run iperf3-srv_10.42.42.10(pid=10128): Terminating (SIGTERM) 07:53:13.570956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10149): Terminating (SIGTERM) 07:53:13.615249 run iperf3-srv_10.42.42.10(pid=10150): Terminating (SIGTERM) 07:53:13.661791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10151): Terminating (SIGTERM) 07:53:13.706374 run iperf3-srv_10.42.42.10(pid=10153): Terminating (SIGTERM) 07:53:13.751494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Terminating (SIGTERM) 07:53:13.795625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Terminating (SIGTERM) 07:53:13.841405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10163): Terminating (SIGTERM) 07:53:13.887098 --- ParallelTerminationStrategy: PID 9949 died... 07:53:13.908110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9949): Terminated: ok {rc=0} 07:53:13.957577 --- ParallelTerminationStrategy: PID 9977 died... 07:53:13.978133 run iperf3-srv_10.42.42.10(pid=9977): Terminated {rc=256} 07:53:14.025707 --- ParallelTerminationStrategy: PID 10082 died... 07:53:14.046259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10082): Terminated: ok {rc=0} 07:53:14.094154 --- ParallelTerminationStrategy: PID 10128 died... 07:53:14.114868 run iperf3-srv_10.42.42.10(pid=10128): Terminated {rc=256} 07:53:14.162650 --- ParallelTerminationStrategy: PID 10149 died... 07:53:14.183420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10149): Terminated: ok {rc=0} 07:53:14.231408 --- ParallelTerminationStrategy: PID 10150 died... 07:53:14.252096 run iperf3-srv_10.42.42.10(pid=10150): Terminated {rc=256} 07:53:14.299882 --- ParallelTerminationStrategy: PID 10151 died... 07:53:14.321082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10151): Terminated: ok {rc=0} 07:53:14.369083 --- ParallelTerminationStrategy: PID 10153 died... 07:53:14.389738 run iperf3-srv_10.42.42.10(pid=10153): Terminated {rc=256} 07:53:14.438238 --- ParallelTerminationStrategy: PID 10157 died... 07:53:14.459002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Terminated: ok {rc=0} 07:53:14.506764 --- ParallelTerminationStrategy: PID 10160 died... 07:53:14.527454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Terminated: ok {rc=0} 07:53:14.575593 --- ParallelTerminationStrategy: PID 10163 died... 07:53:14.596610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10163): Terminated: ok {rc=0} 07:53:14.688433 bus /gobi_4: Setting Powered False 07:53:15.789143 bus /gobi_4: Setting Powered False 07:53:16.955029 bus /gobi_1: Setting Powered False 07:53:18.092813 bus /gobi_1: Setting Powered False 07:53:19.213042 bus /gobi_0: Setting Powered False 07:53:20.317857 bus /gobi_0: Setting Powered False 07:53:21.439153 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 07:53:22.548442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:22.562068 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:53:22.615069 tst ping.py: using LAC 20016 07:53:22.742841 tst ping.py: using RAC 126 07:53:22.872660 tst ping.py: using CellId 20016 07:53:22.999835 tst ping.py: using BVCI 20017 07:53:23.119705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.132474 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.145241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.158023 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.170341 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.182793 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.195307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:23.207693 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:53:23.330908 tst ping.py:19: start network... 07:53:23.550517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:24.057721 run create_hlr_db(pid=10165): Launched 07:53:24.223785 bus /gobi_6: Setting Powered False 07:53:25.285460 run create_hlr_db(pid=10165): Terminated: ok {rc=0} 07:53:25.716280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10167): Launched 07:53:26.009731 run osmo-hlr_10.42.42.2(pid=10168): Launched 07:53:26.122239 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:26.632926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10170): Launched 07:53:26.928305 run osmo-stp_10.42.42.5(pid=10171): Launched 07:53:27.041429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:27.553538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10173): Launched 07:53:27.666437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:27.916367 run patchelf(pid=10174): Launched 07:53:28.080582 run osmo-stp_10.42.42.5(pid=10171): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10171)] 07:53:28.206571 run osmo-stp_10.42.42.5(pid=10171): stdout: | (launched: 2022-12-09_07:53:26.872557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:28.333647 run osmo-stp_10.42.42.5(pid=10171): stderr: | 20221209075327039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075327040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075327040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075327040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075327041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075327041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075327041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:28.460682 run osmo-stp_10.42.42.5(pid=10171): stdout: | (launched: 2022-12-09_07:53:26.872557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:28.582779 run osmo-stp_10.42.42.5(pid=10171): stderr: | 20221209075327039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075327040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075327040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075327040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075327041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075327041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075327041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:28.726759 run patchelf(pid=10174): Terminating (SIGINT) 07:53:28.891746 run patchelf(pid=10174): Terminated: ok {rc=0} 07:53:29.011174 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10171): Process ended prematurely: osmo-stp_10.42.42.5(pid=10171) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10171)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 07:53:29.020433 tst ping.py:22: Test FAILED (6.5 sec) 07:53:29.047759 run osmo-hlr_10.42.42.2(pid=10168): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10168)] 07:53:29.096018 run osmo-hlr_10.42.42.2(pid=10168): stdout: | (launched: 2022-12-09_07:53:25.954839) 07:53:29.145908 run osmo-hlr_10.42.42.2(pid=10168): stderr: | 20221209075326131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075326131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075326131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075326131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075326131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075326131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075326166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075326176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075326176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075326176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:29.196479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10167): Terminating (SIGTERM) 07:53:29.236984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10170): Terminating (SIGTERM) 07:53:29.277169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10173): Terminating (SIGTERM) 07:53:29.317630 --- ParallelTerminationStrategy: PID 10167 died... 07:53:29.336688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10167): Terminated: ok {rc=0} 07:53:29.381397 --- ParallelTerminationStrategy: PID 10170 died... 07:53:29.399938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10170): Terminated: ok {rc=0} 07:53:29.444192 --- ParallelTerminationStrategy: PID 10173 died... 07:53:29.462881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10173): Terminated: ok {rc=0} 07:53:29.546299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:53:30.632449 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:30.646525 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:53:30.695934 tst ping_idle_ping.py: using LAC 20017 07:53:30.820737 tst ping_idle_ping.py: using RAC 127 07:53:30.983653 tst ping_idle_ping.py: using CellId 20017 07:53:31.111230 tst ping_idle_ping.py: using BVCI 20018 07:53:31.263211 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.277101 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.289715 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.303724 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.318320 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.330139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.342368 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:53:31.354685 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:53:31.474298 tst ping_idle_ping.py:24: start network... 07:53:31.681313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:32.197327 run create_hlr_db(pid=10175): Launched 07:53:32.336920 bus /gobi_6: Setting Powered False 07:53:33.396745 run create_hlr_db(pid=10175): Terminated: ok {rc=0} 07:53:33.811440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Launched 07:53:34.106799 run osmo-hlr_10.42.42.2(pid=10178): Launched 07:53:34.219815 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:34.741831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Launched 07:53:35.037559 run osmo-stp_10.42.42.5(pid=10181): Launched 07:53:35.151055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:35.661706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10183): Launched 07:53:35.773784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:36.024640 run patchelf(pid=10184): Launched 07:53:36.188808 run osmo-stp_10.42.42.5(pid=10181): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] 07:53:36.313496 run osmo-stp_10.42.42.5(pid=10181): stdout: | (launched: 2022-12-09_07:53:34.982302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:36.440308 run osmo-stp_10.42.42.5(pid=10181): stderr: | 20221209075335152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075335152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075335153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075335153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075335153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075335154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075335154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:36.566973 run osmo-stp_10.42.42.5(pid=10181): stdout: | (launched: 2022-12-09_07:53:34.982302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:36.688548 run osmo-stp_10.42.42.5(pid=10181): stderr: | 20221209075335152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075335152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075335153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075335153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075335153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075335154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075335154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:36.831807 run patchelf(pid=10184): Terminating (SIGINT) 07:53:36.996391 run patchelf(pid=10184): Terminated: ok {rc=0} 07:53:37.115125 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10181): Process ended prematurely: osmo-stp_10.42.42.5(pid=10181) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 07:53:37.124199 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:53:37.151064 run osmo-hlr_10.42.42.2(pid=10178): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10178)] 07:53:37.198969 run osmo-hlr_10.42.42.2(pid=10178): stdout: | (launched: 2022-12-09_07:53:34.051546) 07:53:37.248053 run osmo-hlr_10.42.42.2(pid=10178): stderr: | 20221209075334225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075334225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075334225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075334225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075334226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075334226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075334238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075334248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075334248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075334248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:37.297772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Terminating (SIGTERM) 07:53:37.337389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Terminating (SIGTERM) 07:53:37.376934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10183): Terminating (SIGTERM) 07:53:37.416829 --- ParallelTerminationStrategy: PID 10177 died... 07:53:37.435843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Terminated: ok {rc=0} 07:53:37.479942 --- ParallelTerminationStrategy: PID 10180 died... 07:53:37.498607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Terminated: ok {rc=0} 07:53:37.542368 --- ParallelTerminationStrategy: PID 10183 died... 07:53:37.560923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10183): Terminated: ok {rc=0} 07:53:37.643704 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:53:38.950927 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:53:38.958010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:53:38.990162 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:53:39.031021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:53:39.122845 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:53:39.154349 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:53:39.195052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:53:39.793373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:53:39.846040 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:39.858125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:53:39.927476 tst cs_paging_gprs_active.py: using LAC 20018 07:53:40.054514 tst cs_paging_gprs_active.py: using RAC 128 07:53:40.182163 tst cs_paging_gprs_active.py: using CellId 20018 07:53:40.309004 tst cs_paging_gprs_active.py: using BVCI 20019 07:53:40.426250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.437933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.449391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.461331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.473359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.485657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.497858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.509364 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:40.521111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:53:40.645079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:53:40.762415 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:53:40.964879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:41.268214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Launched 07:53:41.532163 run iperf3-srv_10.42.42.10(pid=10189): Launched 07:53:41.645542 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:53:41.847363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:42.151050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10190): Launched 07:53:42.413753 run iperf3-srv_10.42.42.10(pid=10191): Launched 07:53:42.526608 tst cs_paging_gprs_active.py:38: start network... 07:53:42.727246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:43.192899 run create_hlr_db(pid=10192): Launched 07:53:43.309926 bus /gobi_6: Setting Powered False 07:53:44.370168 run create_hlr_db(pid=10192): Terminated: ok {rc=0} 07:53:44.811710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10194): Launched 07:53:45.134100 run osmo-hlr_10.42.42.2(pid=10195): Launched 07:53:45.257854 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:45.810759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10197): Launched 07:53:46.170942 run osmo-stp_10.42.42.5(pid=10198): Launched 07:53:46.412921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:47.041574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10200): Launched 07:53:47.175465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:47.450404 run patchelf(pid=10201): Launched 07:53:47.628432 run osmo-stp_10.42.42.5(pid=10198): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10198)] 07:53:47.764604 run osmo-stp_10.42.42.5(pid=10198): stdout: | (launched: 2022-12-09_07:53:46.110398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:47.902223 run osmo-stp_10.42.42.5(pid=10198): stderr: | 20221209075346402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075346402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075346402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075346403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075346403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075346403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075346403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:48.039775 run osmo-stp_10.42.42.5(pid=10198): stdout: | (launched: 2022-12-09_07:53:46.110398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:48.171736 run osmo-stp_10.42.42.5(pid=10198): stderr: | 20221209075346402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075346402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075346402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075346403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075346403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075346403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075346403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:48.328278 run patchelf(pid=10201): Terminating (SIGINT) 07:53:48.507973 run patchelf(pid=10201): Terminated: ok {rc=0} 07:53:48.637739 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10198): Process ended prematurely: osmo-stp_10.42.42.5(pid=10198) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10198)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:53:48.648117 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:53:48.676739 run osmo-hlr_10.42.42.2(pid=10195): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10195)] 07:53:48.726972 run osmo-hlr_10.42.42.2(pid=10195): stdout: | (launched: 2022-12-09_07:53:45.074427) 07:53:48.778574 run osmo-hlr_10.42.42.2(pid=10195): stderr: | 20221209075345274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075345274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075345274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075345275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075345275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075345275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075345287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075345295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075345296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075345296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:48.830442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Terminating (SIGTERM) 07:53:48.872434 run iperf3-srv_10.42.42.10(pid=10189): Terminating (SIGTERM) 07:53:48.913917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10190): Terminating (SIGTERM) 07:53:48.955509 run iperf3-srv_10.42.42.10(pid=10191): Terminating (SIGTERM) 07:53:48.996786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10194): Terminating (SIGTERM) 07:53:49.038287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10197): Terminating (SIGTERM) 07:53:49.079517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10200): Terminating (SIGTERM) 07:53:49.121257 --- ParallelTerminationStrategy: PID 10188 died... 07:53:49.141190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Terminated: ok {rc=0} 07:53:49.186828 --- ParallelTerminationStrategy: PID 10189 died... 07:53:49.206292 run iperf3-srv_10.42.42.10(pid=10189): Terminated {rc=256} 07:53:49.251715 --- ParallelTerminationStrategy: PID 10190 died... 07:53:49.271024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10190): Terminated: ok {rc=0} 07:53:49.316443 --- ParallelTerminationStrategy: PID 10191 died... 07:53:49.336189 run iperf3-srv_10.42.42.10(pid=10191): Terminated {rc=256} 07:53:49.381742 --- ParallelTerminationStrategy: PID 10194 died... 07:53:49.401145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10194): Terminated: ok {rc=0} 07:53:49.446439 --- ParallelTerminationStrategy: PID 10197 died... 07:53:49.465790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10197): Terminated: ok {rc=0} 07:53:49.511250 --- ParallelTerminationStrategy: PID 10200 died... 07:53:49.530759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10200): Terminated: ok {rc=0} 07:53:49.618080 bus /gobi_0: Setting Powered False 07:53:50.717589 bus /gobi_0: Setting Powered False 07:53:51.835755 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:53:52.981625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:52.993713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:53:53.063592 tst iperf3.py: using LAC 20019 07:53:53.189616 tst iperf3.py: using RAC 129 07:53:53.319975 tst iperf3.py: using CellId 20019 07:53:53.446401 tst iperf3.py: using BVCI 20020 07:53:53.562998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.574936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.586628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.598193 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.609629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.621090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.632579 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.644095 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:53:53.655715 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:53:53.775762 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:53:53.992532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:54.315131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Launched 07:53:54.597008 run iperf3-srv_10.42.42.10(pid=10203): Launched 07:53:54.717186 tst iperf3.py:8: start network... 07:53:54.934307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:55.434608 run create_hlr_db(pid=10204): Launched 07:53:55.565592 bus /gobi_6: Setting Powered False 07:53:56.628571 run create_hlr_db(pid=10204): Terminated: ok {rc=0} 07:53:57.058636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10206): Launched 07:53:57.359490 run osmo-hlr_10.42.42.2(pid=10207): Launched 07:53:57.473976 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:58.011262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10209): Launched 07:53:58.311842 run osmo-stp_10.42.42.5(pid=10210): Launched 07:53:58.426722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:58.946579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10212): Launched 07:53:59.061262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:59.316460 run patchelf(pid=10213): Launched 07:53:59.483466 run osmo-stp_10.42.42.5(pid=10210): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10210)] 07:53:59.610796 run osmo-stp_10.42.42.5(pid=10210): stdout: | (launched: 2022-12-09_07:53:58.255874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:59.740029 run osmo-stp_10.42.42.5(pid=10210): stderr: | 20221209075358427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075358427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075358427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075358427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075358428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075358428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075358428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:59.868867 run osmo-stp_10.42.42.5(pid=10210): stdout: | (launched: 2022-12-09_07:53:58.255874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:59.992066 run osmo-stp_10.42.42.5(pid=10210): stderr: | 20221209075358427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075358427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075358427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075358427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075358428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075358428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075358428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:00.138442 run patchelf(pid=10213): Terminating (SIGINT) 07:54:00.306993 run patchelf(pid=10213): Terminated: ok {rc=0} 07:54:00.428755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10210): Process ended prematurely: osmo-stp_10.42.42.5(pid=10210) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10210)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 07:54:00.438786 tst iperf3.py:8: Test FAILED (7.5 sec) 07:54:00.466497 run osmo-hlr_10.42.42.2(pid=10207): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10207)] 07:54:00.514728 run osmo-hlr_10.42.42.2(pid=10207): stdout: | (launched: 2022-12-09_07:53:57.303336) 07:54:00.564273 run osmo-hlr_10.42.42.2(pid=10207): stderr: | 20221209075357480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075357480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075357480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075357480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075357480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075357480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075357493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075357502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075357502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075357502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:00.614141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Terminating (SIGTERM) 07:54:00.654010 run iperf3-srv_10.42.42.10(pid=10203): Terminating (SIGTERM) 07:54:00.693865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10206): Terminating (SIGTERM) 07:54:00.733726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10209): Terminating (SIGTERM) 07:54:00.773631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10212): Terminating (SIGTERM) 07:54:00.814199 --- ParallelTerminationStrategy: PID 10202 died... 07:54:00.836739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Terminated: ok {rc=0} 07:54:00.883251 --- ParallelTerminationStrategy: PID 10203 died... 07:54:00.911800 run iperf3-srv_10.42.42.10(pid=10203): Terminated {rc=256} 07:54:00.960840 --- ParallelTerminationStrategy: PID 10206 died... 07:54:00.981497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10206): Terminated: ok {rc=0} 07:54:01.030524 --- ParallelTerminationStrategy: PID 10209 died... 07:54:01.051029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10209): Terminated: ok {rc=0} 07:54:01.101567 --- ParallelTerminationStrategy: PID 10212 died... 07:54:01.122437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10212): Terminated: ok {rc=0} 07:54:01.213154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:54:02.366408 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:02.378891 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:54:02.452844 tst iperf3m4.py: using LAC 20020 07:54:02.579282 tst iperf3m4.py: using RAC 130 07:54:02.705163 tst iperf3m4.py: using CellId 20020 07:54:02.832847 tst iperf3m4.py: using BVCI 20021 07:54:02.951254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:02.963188 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:02.974723 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:02.986779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:02.998982 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:03.011045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:03.023014 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:03.034843 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:03.046994 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:54:03.170512 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:54:03.290880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:54:03.411080 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:54:03.532114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:54:03.748938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:04.071300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10214): Launched 07:54:04.353523 run iperf3-srv_10.42.42.10(pid=10215): Launched 07:54:04.475084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:54:04.690881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:05.014036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10216): Launched 07:54:05.293593 run iperf3-srv_10.42.42.10(pid=10217): Launched 07:54:05.414212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:54:05.630779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:05.954002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10218): Launched 07:54:06.234908 run iperf3-srv_10.42.42.10(pid=10219): Launched 07:54:06.357198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:54:06.573881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:06.898210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10220): Launched 07:54:07.179602 run iperf3-srv_10.42.42.10(pid=10221): Launched 07:54:07.299177 tst iperf3m4.py:8: start network... 07:54:07.516026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:08.013258 run create_hlr_db(pid=10222): Launched 07:54:08.143288 bus /gobi_6: Setting Powered False 07:54:09.206335 run create_hlr_db(pid=10222): Terminated: ok {rc=0} 07:54:09.654050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10224): Launched 07:54:09.976561 run osmo-hlr_10.42.42.2(pid=10225): Launched 07:54:10.098181 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:10.656323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10227): Launched 07:54:10.980225 run osmo-stp_10.42.42.5(pid=10228): Launched 07:54:11.103914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:11.659564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10230): Launched 07:54:11.783408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:12.056294 run patchelf(pid=10231): Launched 07:54:12.235441 run osmo-stp_10.42.42.5(pid=10228): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10228)] 07:54:12.371230 run osmo-stp_10.42.42.5(pid=10228): stdout: | (launched: 2022-12-09_07:54:10.920509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:12.508357 run osmo-stp_10.42.42.5(pid=10228): stderr: | 20221209075411111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075411111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075411112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075411112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075411112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075411112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075411113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:12.645362 run osmo-stp_10.42.42.5(pid=10228): stdout: | (launched: 2022-12-09_07:54:10.920509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:12.776471 run osmo-stp_10.42.42.5(pid=10228): stderr: | 20221209075411111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075411111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075411112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075411112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075411112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075411112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075411113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:12.932226 run patchelf(pid=10231): Terminating (SIGINT) 07:54:13.111003 run patchelf(pid=10231): Terminated: ok {rc=0} 07:54:13.239819 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10228): Process ended prematurely: osmo-stp_10.42.42.5(pid=10228) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10228)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:54:13.250333 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:54:13.278850 run osmo-hlr_10.42.42.2(pid=10225): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10225)] 07:54:13.328503 run osmo-hlr_10.42.42.2(pid=10225): stdout: | (launched: 2022-12-09_07:54:09.916572) 07:54:13.380174 run osmo-hlr_10.42.42.2(pid=10225): stderr: | 20221209075410116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075410117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075410117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075410117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075410117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075410117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075410129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075410137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075410137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075410137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:13.432021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10214): Terminating (SIGTERM) 07:54:13.473265 run iperf3-srv_10.42.42.10(pid=10215): Terminating (SIGTERM) 07:54:13.514757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10216): Terminating (SIGTERM) 07:54:13.556241 run iperf3-srv_10.42.42.10(pid=10217): Terminating (SIGTERM) 07:54:13.597677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10218): Terminating (SIGTERM) 07:54:13.639283 run iperf3-srv_10.42.42.10(pid=10219): Terminating (SIGTERM) 07:54:13.694625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10220): Terminating (SIGTERM) 07:54:13.736775 run iperf3-srv_10.42.42.10(pid=10221): Terminating (SIGTERM) 07:54:13.777901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10224): Terminating (SIGTERM) 07:54:13.819098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10227): Terminating (SIGTERM) 07:54:13.860199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10230): Terminating (SIGTERM) 07:54:13.901784 --- ParallelTerminationStrategy: PID 10214 died... 07:54:13.921626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10214): Terminated: ok {rc=0} 07:54:13.967206 --- ParallelTerminationStrategy: PID 10215 died... 07:54:13.986638 run iperf3-srv_10.42.42.10(pid=10215): Terminated {rc=256} 07:54:14.032168 --- ParallelTerminationStrategy: PID 10216 died... 07:54:14.051408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10216): Terminated: ok {rc=0} 07:54:14.097026 --- ParallelTerminationStrategy: PID 10217 died... 07:54:14.116299 run iperf3-srv_10.42.42.10(pid=10217): Terminated {rc=256} 07:54:14.161659 --- ParallelTerminationStrategy: PID 10218 died... 07:54:14.180880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10218): Terminated: ok {rc=0} 07:54:14.226587 --- ParallelTerminationStrategy: PID 10219 died... 07:54:14.246006 run iperf3-srv_10.42.42.10(pid=10219): Terminated {rc=256} 07:54:14.291670 --- ParallelTerminationStrategy: PID 10220 died... 07:54:14.311165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10220): Terminated: ok {rc=0} 07:54:14.357491 --- ParallelTerminationStrategy: PID 10221 died... 07:54:14.376843 run iperf3-srv_10.42.42.10(pid=10221): Terminated {rc=256} 07:54:14.422577 --- ParallelTerminationStrategy: PID 10224 died... 07:54:14.442111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10224): Terminated: ok {rc=0} 07:54:14.487874 --- ParallelTerminationStrategy: PID 10227 died... 07:54:14.507358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10227): Terminated: ok {rc=0} 07:54:14.553144 --- ParallelTerminationStrategy: PID 10230 died... 07:54:14.572565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10230): Terminated: ok {rc=0} 07:54:14.660153 bus /gobi_4: Setting Powered False 07:54:15.759190 bus /gobi_4: Setting Powered False 07:54:16.878409 bus /gobi_1: Setting Powered False 07:54:17.974494 bus /gobi_1: Setting Powered False 07:54:19.090166 bus /gobi_0: Setting Powered False 07:54:20.189048 bus /gobi_0: Setting Powered False 07:54:21.304934 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:54:22.408106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:22.419830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:54:22.485811 tst ping.py: using LAC 20021 07:54:22.615325 tst ping.py: using RAC 131 07:54:22.738922 tst ping.py: using CellId 20021 07:54:22.861397 tst ping.py: using BVCI 20022 07:54:22.975157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:22.987100 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:22.998836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:23.010694 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:23.022177 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:23.034228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:23.046065 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:23.057677 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:54:23.175807 tst ping.py:19: start network... 07:54:23.386439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:23.871459 run create_hlr_db(pid=10232): Launched 07:54:23.998063 bus /gobi_6: Setting Powered False 07:54:25.059959 run create_hlr_db(pid=10232): Terminated: ok {rc=0} 07:54:25.479430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10234): Launched 07:54:25.771956 run osmo-hlr_10.42.42.2(pid=10235): Launched 07:54:25.883127 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:26.402202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10237): Launched 07:54:26.694974 run osmo-stp_10.42.42.5(pid=10238): Launched 07:54:26.806067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:27.310305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10240): Launched 07:54:27.422219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:27.670333 run patchelf(pid=10241): Launched 07:54:27.833283 run osmo-stp_10.42.42.5(pid=10238): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10238)] 07:54:27.957136 run osmo-stp_10.42.42.5(pid=10238): stdout: | (launched: 2022-12-09_07:54:26.640186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:28.082420 run osmo-stp_10.42.42.5(pid=10238): stderr: | 20221209075426804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075426804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075426804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075426805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075426805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075426806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075426806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:28.207989 run osmo-stp_10.42.42.5(pid=10238): stdout: | (launched: 2022-12-09_07:54:26.640186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:28.328034 run osmo-stp_10.42.42.5(pid=10238): stderr: | 20221209075426804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075426804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075426804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075426805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075426805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075426806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075426806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:28.470684 run patchelf(pid=10241): Terminating (SIGINT) 07:54:28.634212 run patchelf(pid=10241): Terminated: ok {rc=0} 07:54:28.752062 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10238): Process ended prematurely: osmo-stp_10.42.42.5(pid=10238) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10238)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 07:54:28.761273 tst ping.py:22: Test FAILED (6.3 sec) 07:54:28.788620 run osmo-hlr_10.42.42.2(pid=10235): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10235)] 07:54:28.836321 run osmo-hlr_10.42.42.2(pid=10235): stdout: | (launched: 2022-12-09_07:54:25.717539) 07:54:28.885933 run osmo-hlr_10.42.42.2(pid=10235): stderr: | 20221209075425891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075425891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075425891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075425891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075425891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075425891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075425905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075425914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075425914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075425914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:28.935635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10234): Terminating (SIGTERM) 07:54:28.975323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10237): Terminating (SIGTERM) 07:54:29.015120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10240): Terminating (SIGTERM) 07:54:29.055286 --- ParallelTerminationStrategy: PID 10234 died... 07:54:29.074097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10234): Terminated: ok {rc=0} 07:54:29.118597 --- ParallelTerminationStrategy: PID 10237 died... 07:54:29.137200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10237): Terminated: ok {rc=0} 07:54:29.181496 --- ParallelTerminationStrategy: PID 10240 died... 07:54:29.200045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10240): Terminated: ok {rc=0} 07:54:29.283151 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:54:30.366764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:30.378811 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:54:30.446560 tst ping_idle_ping.py: using LAC 20022 07:54:30.562837 tst ping_idle_ping.py: using RAC 132 07:54:30.679758 tst ping_idle_ping.py: using CellId 20022 07:54:30.802557 tst ping_idle_ping.py: using BVCI 20023 07:54:30.937790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:30.950122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:30.962051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:30.974575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:30.986815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:30.999053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:31.011148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:54:31.023511 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:54:31.148062 tst ping_idle_ping.py:24: start network... 07:54:31.365574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:31.873614 run create_hlr_db(pid=10242): Launched 07:54:32.030207 bus /gobi_6: Setting Powered False 07:54:33.094092 run create_hlr_db(pid=10242): Terminated: ok {rc=0} 07:54:33.532683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10244): Launched 07:54:33.846115 run osmo-hlr_10.42.42.2(pid=10245): Launched 07:54:33.965187 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:34.506505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10247): Launched 07:54:34.817427 run osmo-stp_10.42.42.5(pid=10248): Launched 07:54:34.935817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:35.476030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10250): Launched 07:54:35.594834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:35.858484 run patchelf(pid=10251): Launched 07:54:36.031150 run osmo-stp_10.42.42.5(pid=10248): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10248)] 07:54:36.163371 run osmo-stp_10.42.42.5(pid=10248): stdout: | (launched: 2022-12-09_07:54:34.759859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:36.296477 run osmo-stp_10.42.42.5(pid=10248): stderr: | 20221209075434947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075434947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075434948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075434948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075434948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075434949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075434949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:36.430734 run osmo-stp_10.42.42.5(pid=10248): stdout: | (launched: 2022-12-09_07:54:34.759859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:36.558915 run osmo-stp_10.42.42.5(pid=10248): stderr: | 20221209075434947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075434947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075434948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075434948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075434948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075434949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075434949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:36.710841 run patchelf(pid=10251): Terminating (SIGINT) 07:54:36.884799 run patchelf(pid=10251): Terminated: ok {rc=0} 07:54:37.010260 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10248): Process ended prematurely: osmo-stp_10.42.42.5(pid=10248) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10248)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:54:37.019752 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:54:37.047454 run osmo-hlr_10.42.42.2(pid=10245): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10245)] 07:54:37.097115 run osmo-hlr_10.42.42.2(pid=10245): stdout: | (launched: 2022-12-09_07:54:33.788171) 07:54:37.148145 run osmo-hlr_10.42.42.2(pid=10245): stderr: | 20221209075433982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075433982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075433982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075433982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075433982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075433982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075433994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075434002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075434002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075434002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:37.199692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10244): Terminating (SIGTERM) 07:54:37.240886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10247): Terminating (SIGTERM) 07:54:37.282271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10250): Terminating (SIGTERM) 07:54:37.323739 --- ParallelTerminationStrategy: PID 10244 died... 07:54:37.343463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10244): Terminated: ok {rc=0} 07:54:37.389304 --- ParallelTerminationStrategy: PID 10247 died... 07:54:37.408669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10247): Terminated: ok {rc=0} 07:54:37.453872 --- ParallelTerminationStrategy: PID 10250 died... 07:54:37.473093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10250): Terminated: ok {rc=0} 07:54:37.560805 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:54:38.870414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:38.877307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:54:38.908153 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:54:38.947837 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:54:39.036668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:54:39.066600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:54:39.106501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:54:39.706665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:54:39.757643 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:39.769157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:54:39.837099 tst cs_paging_gprs_active.py: using LAC 20023 07:54:39.961026 tst cs_paging_gprs_active.py: using RAC 133 07:54:40.084756 tst cs_paging_gprs_active.py: using CellId 20023 07:54:40.208313 tst cs_paging_gprs_active.py: using BVCI 20024 07:54:40.324689 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.336306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.347726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.359479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.370839 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.382127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.393694 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.405074 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:40.416501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:54:40.532937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:54:40.648470 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:54:40.849465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:41.149613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Launched 07:54:41.407753 run iperf3-srv_10.42.42.10(pid=10256): Launched 07:54:41.519334 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:54:41.718668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:42.018229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Launched 07:54:42.278552 run iperf3-srv_10.42.42.10(pid=10258): Launched 07:54:42.390441 tst cs_paging_gprs_active.py:38: start network... 07:54:42.589358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:43.049705 run create_hlr_db(pid=10259): Launched 07:54:43.164143 bus /gobi_6: Setting Powered False 07:54:44.223024 run create_hlr_db(pid=10259): Terminated: ok {rc=0} 07:54:44.663254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10261): Launched 07:54:44.979938 run osmo-hlr_10.42.42.2(pid=10262): Launched 07:54:45.100229 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:45.646039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10264): Launched 07:54:45.971325 run osmo-stp_10.42.42.5(pid=10265): Launched 07:54:46.188475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:46.855382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10267): Launched 07:54:46.985957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:47.271582 run patchelf(pid=10268): Launched 07:54:47.439467 run osmo-stp_10.42.42.5(pid=10265): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10265)] 07:54:47.567593 run osmo-stp_10.42.42.5(pid=10265): stdout: | (launched: 2022-12-09_07:54:45.911731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:47.697147 run osmo-stp_10.42.42.5(pid=10265): stderr: | 20221209075446230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075446230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075446231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075446231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075446231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075446232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075446232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:47.826463 run osmo-stp_10.42.42.5(pid=10265): stdout: | (launched: 2022-12-09_07:54:45.911731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:47.950294 run osmo-stp_10.42.42.5(pid=10265): stderr: | 20221209075446230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075446230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075446231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075446231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075446231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075446232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075446232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:48.096467 run patchelf(pid=10268): Terminating (SIGINT) 07:54:48.263813 run patchelf(pid=10268): Terminated: ok {rc=0} 07:54:48.385207 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10265): Process ended prematurely: osmo-stp_10.42.42.5(pid=10265) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10265)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:54:48.394936 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:54:48.422973 run osmo-hlr_10.42.42.2(pid=10262): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10262)] 07:54:48.471032 run osmo-hlr_10.42.42.2(pid=10262): stdout: | (launched: 2022-12-09_07:54:44.922090) 07:54:48.520604 run osmo-hlr_10.42.42.2(pid=10262): stderr: | 20221209075445116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075445116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075445116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075445116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075445116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075445116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075445128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075445137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075445137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075445137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:48.570622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Terminating (SIGTERM) 07:54:48.610713 run iperf3-srv_10.42.42.10(pid=10256): Terminating (SIGTERM) 07:54:48.650954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Terminating (SIGTERM) 07:54:48.691476 run iperf3-srv_10.42.42.10(pid=10258): Terminating (SIGTERM) 07:54:48.731511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10261): Terminating (SIGTERM) 07:54:48.771903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10264): Terminating (SIGTERM) 07:54:48.812097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10267): Terminating (SIGTERM) 07:54:48.852688 --- ParallelTerminationStrategy: PID 10255 died... 07:54:48.871766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Terminated: ok {rc=0} 07:54:48.916903 --- ParallelTerminationStrategy: PID 10256 died... 07:54:48.935997 run iperf3-srv_10.42.42.10(pid=10256): Terminated {rc=256} 07:54:48.980046 --- ParallelTerminationStrategy: PID 10257 died... 07:54:48.998760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Terminated: ok {rc=0} 07:54:49.042993 --- ParallelTerminationStrategy: PID 10258 died... 07:54:49.061510 run iperf3-srv_10.42.42.10(pid=10258): Terminated {rc=256} 07:54:49.105616 --- ParallelTerminationStrategy: PID 10261 died... 07:54:49.124146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10261): Terminated: ok {rc=0} 07:54:49.168264 --- ParallelTerminationStrategy: PID 10264 died... 07:54:49.186923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10264): Terminated: ok {rc=0} 07:54:49.231284 --- ParallelTerminationStrategy: PID 10267 died... 07:54:49.249866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10267): Terminated: ok {rc=0} 07:54:49.335505 bus /gobi_0: Setting Powered False 07:54:50.432786 bus /gobi_0: Setting Powered False 07:54:51.547204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:54:52.691624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:52.703473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:54:52.769625 tst iperf3.py: using LAC 20024 07:54:52.896784 tst iperf3.py: using RAC 134 07:54:53.021411 tst iperf3.py: using CellId 20024 07:54:53.152285 tst iperf3.py: using BVCI 20025 07:54:53.270509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.282448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.295873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.306980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.318374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.329688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.341094 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.352632 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:54:53.363990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:54:53.478646 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:54:53.678028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:53.977026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10269): Launched 07:54:54.237484 run iperf3-srv_10.42.42.10(pid=10270): Launched 07:54:54.349077 tst iperf3.py:8: start network... 07:54:54.548420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:55.018590 run create_hlr_db(pid=10271): Launched 07:54:55.132826 bus /gobi_6: Setting Powered False 07:54:56.192698 run create_hlr_db(pid=10271): Terminated: ok {rc=0} 07:54:56.609509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10273): Launched 07:54:56.907371 run osmo-hlr_10.42.42.2(pid=10274): Launched 07:54:57.021240 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:57.538011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10276): Launched 07:54:57.835621 run osmo-stp_10.42.42.5(pid=10277): Launched 07:54:57.949418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:58.461012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10279): Launched 07:54:58.574733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:58.825763 run patchelf(pid=10280): Launched 07:54:58.990619 run osmo-stp_10.42.42.5(pid=10277): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10277)] 07:54:59.116315 run osmo-stp_10.42.42.5(pid=10277): stdout: | (launched: 2022-12-09_07:54:57.780754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:59.243942 run osmo-stp_10.42.42.5(pid=10277): stderr: | 20221209075457947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075457947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075457947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075457947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075457948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075457948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075457948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:59.371949 run osmo-stp_10.42.42.5(pid=10277): stdout: | (launched: 2022-12-09_07:54:57.780754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:59.494105 run osmo-stp_10.42.42.5(pid=10277): stderr: | 20221209075457947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075457947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075457947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075457947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075457948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075457948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075457948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:59.638817 run patchelf(pid=10280): Terminating (SIGINT) 07:54:59.804744 run patchelf(pid=10280): Terminated: ok {rc=0} 07:54:59.924434 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10277): Process ended prematurely: osmo-stp_10.42.42.5(pid=10277) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10277)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 07:54:59.934088 tst iperf3.py:8: Test FAILED (7.3 sec) 07:54:59.960700 run osmo-hlr_10.42.42.2(pid=10274): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10274)] 07:55:00.008574 run osmo-hlr_10.42.42.2(pid=10274): stdout: | (launched: 2022-12-09_07:54:56.852767) 07:55:00.058096 run osmo-hlr_10.42.42.2(pid=10274): stderr: | 20221209075457024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075457024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075457024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075457024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075457024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075457024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075457036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075457045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075457045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075457045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:00.107955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10269): Terminating (SIGTERM) 07:55:00.147171 run iperf3-srv_10.42.42.10(pid=10270): Terminating (SIGTERM) 07:55:00.186646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10273): Terminating (SIGTERM) 07:55:00.226162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10276): Terminating (SIGTERM) 07:55:00.265679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10279): Terminating (SIGTERM) 07:55:00.305771 --- ParallelTerminationStrategy: PID 10269 died... 07:55:00.324582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10269): Terminated: ok {rc=0} 07:55:00.368314 --- ParallelTerminationStrategy: PID 10270 died... 07:55:00.387224 run iperf3-srv_10.42.42.10(pid=10270): Terminated {rc=256} 07:55:00.430896 --- ParallelTerminationStrategy: PID 10273 died... 07:55:00.449363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10273): Terminated: ok {rc=0} 07:55:00.493122 --- ParallelTerminationStrategy: PID 10276 died... 07:55:00.511545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10276): Terminated: ok {rc=0} 07:55:00.555489 --- ParallelTerminationStrategy: PID 10279 died... 07:55:00.574048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10279): Terminated: ok {rc=0} 07:55:00.657573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:55:01.819619 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:01.833281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:55:01.906577 tst iperf3m4.py: using LAC 20025 07:55:02.033168 tst iperf3m4.py: using RAC 135 07:55:02.173663 tst iperf3m4.py: using CellId 20025 07:55:02.296335 tst iperf3m4.py: using BVCI 20026 07:55:02.405607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.417112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.428338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.439501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.451605 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.463470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.475598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.486521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:02.498906 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:55:02.620555 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:55:02.744124 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:55:02.865653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:55:02.984073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:55:03.184428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:03.484516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10284): Launched 07:55:03.743536 run iperf3-srv_10.42.42.10(pid=10285): Launched 07:55:03.854899 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:55:04.053723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:04.352467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10286): Launched 07:55:04.610690 run iperf3-srv_10.42.42.10(pid=10287): Launched 07:55:04.721791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:55:04.920344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:05.218533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10288): Launched 07:55:05.477244 run iperf3-srv_10.42.42.10(pid=10289): Launched 07:55:05.588061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:55:05.786487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:06.085136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10290): Launched 07:55:06.344264 run iperf3-srv_10.42.42.10(pid=10291): Launched 07:55:06.456215 tst iperf3m4.py:8: start network... 07:55:06.657295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:07.122075 run create_hlr_db(pid=10292): Launched 07:55:07.237193 bus /gobi_6: Setting Powered False 07:55:08.296824 run create_hlr_db(pid=10292): Terminated: ok {rc=0} 07:55:08.715173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10294): Launched 07:55:09.015843 run osmo-hlr_10.42.42.2(pid=10295): Launched 07:55:09.129789 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:09.660319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10297): Launched 07:55:09.960051 run osmo-stp_10.42.42.5(pid=10298): Launched 07:55:10.073782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:10.589523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10300): Launched 07:55:10.703495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:10.956702 run patchelf(pid=10301): Launched 07:55:11.124614 run osmo-stp_10.42.42.5(pid=10298): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10298)] 07:55:11.252796 run osmo-stp_10.42.42.5(pid=10298): stdout: | (launched: 2022-12-09_07:55:09.904837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:11.383113 run osmo-stp_10.42.42.5(pid=10298): stderr: | 20221209075510072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075510073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075510073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075510073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075510074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075510074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075510074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:11.513207 run osmo-stp_10.42.42.5(pid=10298): stdout: | (launched: 2022-12-09_07:55:09.904837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:11.637513 run osmo-stp_10.42.42.5(pid=10298): stderr: | 20221209075510072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075510073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075510073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075510073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075510074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075510074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075510074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:11.784717 run patchelf(pid=10301): Terminating (SIGINT) 07:55:11.954222 run patchelf(pid=10301): Terminated: ok {rc=0} 07:55:12.075671 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10298): Process ended prematurely: osmo-stp_10.42.42.5(pid=10298) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10298)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:55:12.085416 tst iperf3m4.py:8: Test FAILED (10.3 sec) 07:55:12.112889 run osmo-hlr_10.42.42.2(pid=10295): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10295)] 07:55:12.161230 run osmo-hlr_10.42.42.2(pid=10295): stdout: | (launched: 2022-12-09_07:55:08.959915) 07:55:12.210353 run osmo-hlr_10.42.42.2(pid=10295): stderr: | 20221209075509135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075509135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075509135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075509135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075509135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075509135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075509148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075509156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075509157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075509157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:12.260010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10284): Terminating (SIGTERM) 07:55:12.299260 run iperf3-srv_10.42.42.10(pid=10285): Terminating (SIGTERM) 07:55:12.338964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10286): Terminating (SIGTERM) 07:55:12.378613 run iperf3-srv_10.42.42.10(pid=10287): Terminating (SIGTERM) 07:55:12.418094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10288): Terminating (SIGTERM) 07:55:12.457411 run iperf3-srv_10.42.42.10(pid=10289): Terminating (SIGTERM) 07:55:12.497011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10290): Terminating (SIGTERM) 07:55:12.536778 run iperf3-srv_10.42.42.10(pid=10291): Terminating (SIGTERM) 07:55:12.576237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10294): Terminating (SIGTERM) 07:55:12.616334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10297): Terminating (SIGTERM) 07:55:12.656034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10300): Terminating (SIGTERM) 07:55:12.695966 --- ParallelTerminationStrategy: PID 10284 died... 07:55:12.715020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10284): Terminated: ok {rc=0} 07:55:12.759076 --- ParallelTerminationStrategy: PID 10285 died... 07:55:12.778013 run iperf3-srv_10.42.42.10(pid=10285): Terminated {rc=256} 07:55:12.822189 --- ParallelTerminationStrategy: PID 10286 died... 07:55:12.840987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10286): Terminated: ok {rc=0} 07:55:12.884900 --- ParallelTerminationStrategy: PID 10287 died... 07:55:12.903819 run iperf3-srv_10.42.42.10(pid=10287): Terminated {rc=256} 07:55:12.947865 --- ParallelTerminationStrategy: PID 10288 died... 07:55:12.966595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10288): Terminated: ok {rc=0} 07:55:13.010585 --- ParallelTerminationStrategy: PID 10289 died... 07:55:13.029611 run iperf3-srv_10.42.42.10(pid=10289): Terminated {rc=256} 07:55:13.073708 --- ParallelTerminationStrategy: PID 10290 died... 07:55:13.092449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10290): Terminated: ok {rc=0} 07:55:13.137396 --- ParallelTerminationStrategy: PID 10291 died... 07:55:13.156164 run iperf3-srv_10.42.42.10(pid=10291): Terminated {rc=256} 07:55:13.200318 --- ParallelTerminationStrategy: PID 10294 died... 07:55:13.219190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10294): Terminated: ok {rc=0} 07:55:13.263155 --- ParallelTerminationStrategy: PID 10297 died... 07:55:13.282219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10297): Terminated: ok {rc=0} 07:55:13.326417 --- ParallelTerminationStrategy: PID 10300 died... 07:55:13.345262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10300): Terminated: ok {rc=0} 07:55:13.431766 bus /gobi_4: Setting Powered False 07:55:14.531811 bus /gobi_4: Setting Powered False 07:55:15.647302 bus /gobi_1: Setting Powered False 07:55:16.742656 bus /gobi_1: Setting Powered False 07:55:17.861791 bus /gobi_0: Setting Powered False 07:55:18.959438 bus /gobi_0: Setting Powered False 07:55:20.074626 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:55:21.176493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.189232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:55:21.258482 tst ping.py: using LAC 20026 07:55:21.386577 tst ping.py: using RAC 136 07:55:21.512140 tst ping.py: using CellId 20026 07:55:21.642990 tst ping.py: using BVCI 20027 07:55:21.759412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.771361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.783086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.794755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.806157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.817671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.829331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:21.840658 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:55:21.960351 tst ping.py:19: start network... 07:55:22.174648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:22.667607 run create_hlr_db(pid=10302): Launched 07:55:22.796011 bus /gobi_6: Setting Powered False 07:55:23.858148 run create_hlr_db(pid=10302): Terminated: ok {rc=0} 07:55:24.299519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10304): Launched 07:55:24.618605 run osmo-hlr_10.42.42.2(pid=10305): Launched 07:55:24.740229 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:25.288287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10307): Launched 07:55:25.609218 run osmo-stp_10.42.42.5(pid=10308): Launched 07:55:25.731627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:26.282274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10310): Launched 07:55:26.406387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:26.676366 run patchelf(pid=10311): Launched 07:55:26.854929 run osmo-stp_10.42.42.5(pid=10308): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10308)] 07:55:26.989803 run osmo-stp_10.42.42.5(pid=10308): stdout: | (launched: 2022-12-09_07:55:25.550563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:27.126128 run osmo-stp_10.42.42.5(pid=10308): stderr: | 20221209075525741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075525741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075525741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075525742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075525742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075525742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075525742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:27.262427 run osmo-stp_10.42.42.5(pid=10308): stdout: | (launched: 2022-12-09_07:55:25.550563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:27.393597 run osmo-stp_10.42.42.5(pid=10308): stderr: | 20221209075525741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075525741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075525741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075525742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075525742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075525742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075525742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:27.549417 run patchelf(pid=10311): Terminating (SIGINT) 07:55:27.727018 run patchelf(pid=10311): Terminated: ok {rc=0} 07:55:27.854659 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10308): Process ended prematurely: osmo-stp_10.42.42.5(pid=10308) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10308)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 07:55:27.864273 tst ping.py:22: Test FAILED (6.7 sec) 07:55:27.892292 run osmo-hlr_10.42.42.2(pid=10305): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10305)] 07:55:27.941938 run osmo-hlr_10.42.42.2(pid=10305): stdout: | (launched: 2022-12-09_07:55:24.560260) 07:55:27.993835 run osmo-hlr_10.42.42.2(pid=10305): stderr: | 20221209075524756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075524756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075524756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075524756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075524756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075524756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075524768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075524776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075524776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075524776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:28.045505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10304): Terminating (SIGTERM) 07:55:28.087143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10307): Terminating (SIGTERM) 07:55:28.128828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10310): Terminating (SIGTERM) 07:55:28.170829 --- ParallelTerminationStrategy: PID 10304 died... 07:55:28.190710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10304): Terminated: ok {rc=0} 07:55:28.237291 --- ParallelTerminationStrategy: PID 10307 died... 07:55:28.256939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10307): Terminated: ok {rc=0} 07:55:28.302965 --- ParallelTerminationStrategy: PID 10310 died... 07:55:28.322476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10310): Terminated: ok {rc=0} 07:55:28.410227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:55:29.497131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:29.510280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:55:29.581781 tst ping_idle_ping.py: using LAC 20027 07:55:29.707237 tst ping_idle_ping.py: using RAC 137 07:55:29.834168 tst ping_idle_ping.py: using CellId 20027 07:55:29.963945 tst ping_idle_ping.py: using BVCI 20028 07:55:30.081588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.093466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.104917 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.116691 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.128225 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.139783 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.151416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:55:30.162984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:55:30.282544 tst ping_idle_ping.py:24: start network... 07:55:30.499041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:31.016236 run create_hlr_db(pid=10312): Launched 07:55:31.151976 bus /gobi_6: Setting Powered False 07:55:32.214335 run create_hlr_db(pid=10312): Terminated: ok {rc=0} 07:55:32.663018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10314): Launched 07:55:32.984225 run osmo-hlr_10.42.42.2(pid=10315): Launched 07:55:33.106707 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:33.659660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10317): Launched 07:55:33.979016 run osmo-stp_10.42.42.5(pid=10318): Launched 07:55:34.102839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:34.655893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10320): Launched 07:55:34.779192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:35.049661 run patchelf(pid=10321): Launched 07:55:35.227103 run osmo-stp_10.42.42.5(pid=10318): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10318)] 07:55:35.362175 run osmo-stp_10.42.42.5(pid=10318): stdout: | (launched: 2022-12-09_07:55:33.920358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:35.498986 run osmo-stp_10.42.42.5(pid=10318): stderr: | 20221209075534109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075534110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075534110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075534110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075534111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075534111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075534111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:35.635849 run osmo-stp_10.42.42.5(pid=10318): stdout: | (launched: 2022-12-09_07:55:33.920358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:35.766864 run osmo-stp_10.42.42.5(pid=10318): stderr: | 20221209075534109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075534110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075534110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075534110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075534111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075534111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075534111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:35.921910 run patchelf(pid=10321): Terminating (SIGINT) 07:55:36.099500 run patchelf(pid=10321): Terminated: ok {rc=0} 07:55:36.227675 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10318): Process ended prematurely: osmo-stp_10.42.42.5(pid=10318) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10318)] [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:55:36.237486 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:55:36.265689 run osmo-hlr_10.42.42.2(pid=10315): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10315)] 07:55:36.315261 run osmo-hlr_10.42.42.2(pid=10315): stdout: | (launched: 2022-12-09_07:55:32.925436) 07:55:36.366660 run osmo-hlr_10.42.42.2(pid=10315): stderr: | 20221209075533121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075533121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075533121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075533121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075533121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075533121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075533133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075533142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075533142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075533142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:36.418591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10314): Terminating (SIGTERM) 07:55:36.460164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10317): Terminating (SIGTERM) 07:55:36.501635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10320): Terminating (SIGTERM) 07:55:36.543463 --- ParallelTerminationStrategy: PID 10314 died... 07:55:36.563423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10314): Terminated: ok {rc=0} 07:55:36.609324 --- ParallelTerminationStrategy: PID 10317 died... 07:55:36.629331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10317): Terminated: ok {rc=0} 07:55:36.674970 --- ParallelTerminationStrategy: PID 10320 died... 07:55:36.694413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10320): Terminated: ok {rc=0} 07:55:36.781698 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:55:38.093962 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:55:38.101541 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:55:38.131994 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:55:38.167852 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:55:38.221139 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:55:38.251375 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:55:38.287118 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:55:38.851025 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:55:38.856312 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:38.868222 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:55:38.935780 tst switch_tch_pdch.py: using LAC 20028 07:55:39.059017 tst switch_tch_pdch.py: using RAC 138 07:55:39.182404 tst switch_tch_pdch.py: using CellId 20028 07:55:39.307526 tst switch_tch_pdch.py: using BVCI 20029 07:55:39.423583 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.435656 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.447416 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.459261 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.470980 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.482769 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.494702 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:55:39.506473 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:55:39.627797 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:55:39.744330 tst switch_tch_pdch.py:51: start network... 07:55:39.944724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:40.408675 run create_hlr_db(pid=10328): Launched 07:55:40.523683 bus /gobi_6: Setting Powered False 07:55:41.583823 run create_hlr_db(pid=10328): Terminated: ok {rc=0} 07:55:42.044389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10330): Launched 07:55:42.364360 run osmo-hlr_10.42.42.2(pid=10331): Launched 07:55:42.486653 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:43.039379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10333): Launched 07:55:43.356487 run osmo-stp_10.42.42.5(pid=10334): Launched 07:55:43.480125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:44.034195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10336): Launched 07:55:44.157747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:44.428128 run patchelf(pid=10337): Launched 07:55:44.606913 run osmo-stp_10.42.42.5(pid=10334): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10334)] 07:55:44.741573 run osmo-stp_10.42.42.5(pid=10334): stdout: | (launched: 2022-12-09_07:55:43.298036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:44.877961 run osmo-stp_10.42.42.5(pid=10334): stderr: | 20221209075543484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075543485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075543485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075543485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075543486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075543486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075543486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:45.014588 run osmo-stp_10.42.42.5(pid=10334): stdout: | (launched: 2022-12-09_07:55:43.298036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:45.145279 run osmo-stp_10.42.42.5(pid=10334): stderr: | 20221209075543484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075543485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075543485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075543485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075543486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075543486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075543486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:45.300200 run patchelf(pid=10337): Terminating (SIGINT) 07:55:45.478422 run patchelf(pid=10337): Terminated: ok {rc=0} 07:55:45.606591 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10334): Process ended prematurely: osmo-stp_10.42.42.5(pid=10334) [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10334)] [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:55:45.616546 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 07:55:45.644789 run osmo-hlr_10.42.42.2(pid=10331): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10331)] 07:55:45.694583 run osmo-hlr_10.42.42.2(pid=10331): stdout: | (launched: 2022-12-09_07:55:42.304850) 07:55:45.746228 run osmo-hlr_10.42.42.2(pid=10331): stderr: | 20221209075542500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075542500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075542500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075542500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075542500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075542500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075542513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075542523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075542523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075542523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:45.798196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10330): Terminating (SIGTERM) 07:55:45.839904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10333): Terminating (SIGTERM) 07:55:45.893786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10336): Terminating (SIGTERM) 07:55:45.941826 --- ParallelTerminationStrategy: PID 10330 died... 07:55:45.961660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10330): Terminated: ok {rc=0} 07:55:46.023123 --- ParallelTerminationStrategy: PID 10333 died... 07:55:46.046832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10333): Terminated: ok {rc=0} 07:55:46.106304 --- ParallelTerminationStrategy: PID 10336 died... 07:55:46.131220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10336): Terminated: ok {rc=0} 07:55:46.229792 bus /gobi_0: Setting Powered False 07:55:47.325740 bus /gobi_0: Setting Powered False 07:55:48.440650 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:55:49.704003 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:55:49.710630 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:55:49.741256 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:55:49.777010 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:55:49.830993 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:55:49.861216 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:55:49.896900 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:55:50.458377 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:55:50.463569 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:50.475285 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:55:50.543145 tst switch_tch_pdch.py: using LAC 20029 07:55:50.671888 tst switch_tch_pdch.py: using RAC 139 07:55:50.795818 tst switch_tch_pdch.py: using CellId 20029 07:55:50.918355 tst switch_tch_pdch.py: using BVCI 20030 07:55:51.034937 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.046666 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.058190 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.069813 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.081299 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.092797 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.104467 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:55:51.116048 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:55:51.232044 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:55:51.351687 tst switch_tch_pdch.py:51: start network... 07:55:51.566977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:52.034488 run create_hlr_db(pid=10341): Launched 07:55:52.162581 bus /gobi_6: Setting Powered False 07:55:53.225894 run create_hlr_db(pid=10341): Terminated: ok {rc=0} 07:55:53.641940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10343): Launched 07:55:53.960089 run osmo-hlr_10.42.42.2(pid=10344): Launched 07:55:54.080890 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:54.600777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10346): Launched 07:55:54.917386 run osmo-stp_10.42.42.5(pid=10347): Launched 07:55:55.039629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:55.560023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10349): Launched 07:55:55.682024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:55.950818 run patchelf(pid=10350): Launched 07:55:56.128614 run osmo-stp_10.42.42.5(pid=10347): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10347)] 07:55:56.262739 run osmo-stp_10.42.42.5(pid=10347): stdout: | (launched: 2022-12-09_07:55:54.859085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:56.398879 run osmo-stp_10.42.42.5(pid=10347): stderr: | 20221209075555048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075555048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075555048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075555048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075555049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075555049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075555049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:56.534781 run osmo-stp_10.42.42.5(pid=10347): stdout: | (launched: 2022-12-09_07:55:54.859085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:56.665128 run osmo-stp_10.42.42.5(pid=10347): stderr: | 20221209075555048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075555048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075555048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075555048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075555049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075555049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075555049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:56.819001 run patchelf(pid=10350): Terminating (SIGINT) 07:55:56.995700 run patchelf(pid=10350): Terminated: ok {rc=0} 07:55:57.123644 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10347): Process ended prematurely: osmo-stp_10.42.42.5(pid=10347) [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10347)] [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:55:57.133219 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:55:57.160918 run osmo-hlr_10.42.42.2(pid=10344): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10344)] 07:55:57.210558 run osmo-hlr_10.42.42.2(pid=10344): stdout: | (launched: 2022-12-09_07:55:53.901621) 07:55:57.262102 run osmo-hlr_10.42.42.2(pid=10344): stderr: | 20221209075554098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075554098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075554098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075554098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075554098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075554098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075554128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075554139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075554139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075554139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:57.314064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10343): Terminating (SIGTERM) 07:55:57.355300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10346): Terminating (SIGTERM) 07:55:57.397177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10349): Terminating (SIGTERM) 07:55:57.439018 --- ParallelTerminationStrategy: PID 10343 died... 07:55:57.458519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10343): Terminated: ok {rc=0} 07:55:57.504268 --- ParallelTerminationStrategy: PID 10346 died... 07:55:57.523771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10346): Terminated: ok {rc=0} 07:55:57.569539 --- ParallelTerminationStrategy: PID 10349 died... 07:55:57.589125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10349): Terminated: ok {rc=0} 07:55:57.677140 bus /gobi_0: Setting Powered False 07:55:58.775645 bus /gobi_0: Setting Powered False 07:55:59.891179 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_sms:nanobts --------------------------------------------------------------------- 07:56:01.156003 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:01.160527 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 07:56:01.187033 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 07:56:01.195361 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 07:56:01.249744 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 07:56:01.275676 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 07:56:01.283798 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 07:56:01.818887 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 07:56:01.825674 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 07:56:01.837763 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 07:56:01.880120 tst mo_mt_sms.py: using LAC 20030 07:56:02.034142 tst mo_mt_sms.py: using RAC 140 07:56:02.185131 tst mo_mt_sms.py: using CellId 20030 07:56:02.307058 tst mo_mt_sms.py: using BVCI 20031 07:56:02.417347 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 07:56:02.534512 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 07:56:02.652098 tst mo_mt_sms.py:9: start nitb and bts... 07:56:02.865162 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:56:03.515450 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10354): Launched 07:56:03.834465 run osmo-nitb_10.42.42.2(pid=10355): Launched 07:56:04.012273 run osmo-nitb_10.42.42.2(pid=10355): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10355)] 07:56:04.154695 run osmo-nitb_10.42.42.2(pid=10355): stdout: | (launched: 2022-12-09_07:56:03.775709) 07:56:04.298860 run osmo-nitb_10.42.42.2(pid=10355): stderr: | (launched: 2022-12-09_07:56:03.823186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:56:04.443481 run osmo-nitb_10.42.42.2(pid=10355): stdout: | (launched: 2022-12-09_07:56:03.775709) 07:56:04.582897 run osmo-nitb_10.42.42.2(pid=10355): stderr: | (launched: 2022-12-09_07:56:03.823186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10355): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10355) [trial-2356↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10355)] 07:56:04.956421 tst osmo-nitb_10.42.42.2(pid=10355): stdout: | (launched: 2022-12-09_07:56:03.775709) 07:56:05.084139 tst osmo-nitb_10.42.42.2(pid=10355): stderr: | (launched: 2022-12-09_07:56:03.823186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:56:05.236258 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10355): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10355) [trial-2356↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10355)] [trial-2356↪nitb_sms:nanobts↪mo_mt_sms.py:11] 07:56:05.245301 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:56:05.252175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10354): Terminating (SIGTERM) 07:56:05.462466 --- ParallelTerminationStrategy: PID 10354 died... 07:56:05.484036 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10354): Terminated: ok {rc=0} 07:56:05.570997 bus /sierra_3: Setting Powered False 07:56:06.669211 bus /sierra_3: Setting Powered False 07:56:07.786473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:nanobts+band-1900 --------------------------------------------------------------------- 07:56:08.973787 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:08.979111 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:56:09.004077 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:56:09.031784 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 07:56:09.084682 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:56:09.109550 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:56:09.137145 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 07:56:09.687355 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 07:56:09.692504 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:09.703737 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:56:09.742981 tst mo_mt_sms.py: using LAC 20031 07:56:09.869046 tst mo_mt_sms.py: using RAC 141 07:56:09.995098 tst mo_mt_sms.py: using CellId 20031 07:56:10.125649 tst mo_mt_sms.py: using BVCI 20032 07:56:10.242095 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:10.253367 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:10.264434 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:10.275519 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:10.286648 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:10.297782 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 07:56:10.413795 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 07:56:10.528378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:10.989222 run create_hlr_db(pid=10359): Launched 07:56:11.104907 bus /sierra_2: Setting Powered False 07:56:12.164530 run create_hlr_db(pid=10359): Terminated: ok {rc=0} 07:56:12.579708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Launched 07:56:12.876406 run osmo-hlr_10.42.42.2(pid=10362): Launched 07:56:12.990946 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:13.515451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Launched 07:56:13.813118 run osmo-stp_10.42.42.5(pid=10365): Launched 07:56:13.926576 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:14.463794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Launched 07:56:14.762147 run osmo-msc_10.42.42.6(pid=10368): Launched 07:56:14.930673 run osmo-stp_10.42.42.5(pid=10365): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] 07:56:15.056229 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-09_07:56:13.758128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:15.182533 run osmo-stp_10.42.42.5(pid=10365): stderr: | 20221209075613924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075613925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075613925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075613925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075613926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075613926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075613926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:15.307143 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-09_07:56:13.758128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:15.426368 run osmo-stp_10.42.42.5(pid=10365): stderr: | 20221209075613924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075613925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075613925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075613925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075613926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075613926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075613926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:15.568059 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2356↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] [trial-2356↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 07:56:15.576494 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 07:56:15.602950 run osmo-hlr_10.42.42.2(pid=10362): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10362)] 07:56:15.652247 run osmo-hlr_10.42.42.2(pid=10362): stdout: | (launched: 2022-12-09_07:56:12.821527) 07:56:15.702116 run osmo-hlr_10.42.42.2(pid=10362): stderr: | 20221209075612994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075612994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075612994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075612994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075612994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075612994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075613007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075613017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075613017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075613017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:15.770746 run osmo-msc_10.42.42.6(pid=10368): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10368)] 07:56:15.818577 run osmo-msc_10.42.42.6(pid=10368): stdout: | (launched: 2022-12-09_07:56:14.707064) 07:56:15.873140 run osmo-msc_10.42.42.6(pid=10368): stderr: | 20221209075614975 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075614975 DLGLOBAL DEBUG validating counter group 0x7fcbb9bc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075614975 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075614975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075614975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075614976 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075614977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075614978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075614978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075614978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:15.924125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminating (SIGTERM) 07:56:15.965508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminating (SIGTERM) 07:56:16.007979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Terminating (SIGTERM) 07:56:16.049447 --- ParallelTerminationStrategy: PID 10361 died... 07:56:16.068430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminated: ok {rc=0} 07:56:16.114721 --- ParallelTerminationStrategy: PID 10364 died... 07:56:16.134000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminated: ok {rc=0} 07:56:16.180011 --- ParallelTerminationStrategy: PID 10367 died... 07:56:16.199220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Terminated: ok {rc=0} 07:56:16.286093 bus /sierra_3: Setting Powered False 07:56:17.386942 bus /sierra_3: Setting Powered False 07:56:18.502277 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 07:56:19.723673 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:19.728454 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:56:19.753228 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 07:56:19.760236 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 07:56:19.795669 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:56:19.819582 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 07:56:19.826851 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 07:56:20.346912 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 07:56:20.353173 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 07:56:20.364455 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:56:20.402764 tst assert_extension.py: using LAC 20032 07:56:20.528201 tst assert_extension.py: using RAC 142 07:56:20.654720 tst assert_extension.py: using CellId 20032 07:56:20.782171 tst assert_extension.py: using BVCI 20033 07:56:20.898909 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 07:56:21.013295 tst assert_extension.py:10: start nitb and bts... 07:56:21.213017 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:56:21.820526 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10373): Launched 07:56:22.118629 run osmo-nitb_10.42.42.2(pid=10374): Launched 07:56:22.283736 run osmo-nitb_10.42.42.2(pid=10374): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10374)] 07:56:22.417321 run osmo-nitb_10.42.42.2(pid=10374): stdout: | (launched: 2022-12-09_07:56:22.063505) 07:56:22.551781 run osmo-nitb_10.42.42.2(pid=10374): stderr: | (launched: 2022-12-09_07:56:22.107991) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:56:22.686771 run osmo-nitb_10.42.42.2(pid=10374): stdout: | (launched: 2022-12-09_07:56:22.063505) 07:56:22.816345 run osmo-nitb_10.42.42.2(pid=10374): stderr: | (launched: 2022-12-09_07:56:22.107991) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10374): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10374) [trial-2356↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10374)] 07:56:23.231881 tst osmo-nitb_10.42.42.2(pid=10374): stdout: | (launched: 2022-12-09_07:56:22.063505) 07:56:23.351819 tst osmo-nitb_10.42.42.2(pid=10374): stderr: | (launched: 2022-12-09_07:56:22.107991) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:56:23.493696 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10374): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10374) [trial-2356↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10374)] [trial-2356↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 07:56:23.502322 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:56:23.508899 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10373): Terminating (SIGTERM) 07:56:23.719787 --- ParallelTerminationStrategy: PID 10373 died... 07:56:23.740233 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10373): Terminated: ok {rc=0} 07:56:23.827071 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:nanobts+band-1900 --------------------------------------------------------------------- 07:56:25.000752 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:25.006215 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:56:25.031425 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:56:25.059601 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 07:56:25.096204 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:56:25.121054 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:56:25.148772 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 07:56:25.680575 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 07:56:25.686088 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:25.697517 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:56:25.736415 tst assert_extension.py: using LAC 20033 07:56:25.855138 tst assert_extension.py: using RAC 143 07:56:25.975151 tst assert_extension.py: using CellId 20033 07:56:26.111935 tst assert_extension.py: using BVCI 20034 07:56:26.219993 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:26.230925 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:26.241687 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:26.252544 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:26.263424 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:26.274253 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 07:56:26.393316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:26.853738 run create_hlr_db(pid=10378): Launched 07:56:26.965842 bus /sierra_2: Setting Powered False 07:56:28.026108 run create_hlr_db(pid=10378): Terminated: ok {rc=0} 07:56:28.441470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10380): Launched 07:56:28.738880 run osmo-hlr_10.42.42.2(pid=10381): Launched 07:56:28.853542 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:29.367698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10383): Launched 07:56:29.665125 run osmo-stp_10.42.42.5(pid=10384): Launched 07:56:29.779018 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:30.318631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10386): Launched 07:56:30.616789 run osmo-msc_10.42.42.6(pid=10387): Launched 07:56:30.786535 run osmo-stp_10.42.42.5(pid=10384): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10384)] 07:56:30.969834 run osmo-stp_10.42.42.5(pid=10384): stdout: | (launched: 2022-12-09_07:56:29.610094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:31.218213 run osmo-stp_10.42.42.5(pid=10384): stderr: | 20221209075629777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075629777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075629777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075629778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075629778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075629778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075629778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:31.349844 run osmo-stp_10.42.42.5(pid=10384): stdout: | (launched: 2022-12-09_07:56:29.610094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:31.475235 run osmo-stp_10.42.42.5(pid=10384): stderr: | 20221209075629777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075629777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075629777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075629778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075629778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075629778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075629778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:31.621131 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10384): Process ended prematurely: osmo-stp_10.42.42.5(pid=10384) [trial-2356↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10384)] [trial-2356↪ussd:nanobts+band-1900↪assert_extension.py:17] 07:56:31.630373 tst assert_extension.py:17: Test FAILED (5.9 sec) 07:56:31.659755 run osmo-hlr_10.42.42.2(pid=10381): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10381)] 07:56:31.710220 run osmo-hlr_10.42.42.2(pid=10381): stdout: | (launched: 2022-12-09_07:56:28.683710) 07:56:31.762218 run osmo-hlr_10.42.42.2(pid=10381): stderr: | 20221209075628856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075628857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075628857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075628857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075628857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075628857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075628873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075628883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075628883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075628883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:31.834099 run osmo-msc_10.42.42.6(pid=10387): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10387)] 07:56:31.884352 run osmo-msc_10.42.42.6(pid=10387): stdout: | (launched: 2022-12-09_07:56:30.561572) 07:56:31.936091 run osmo-msc_10.42.42.6(pid=10387): stderr: | 20221209075630838 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075630838 DLGLOBAL DEBUG validating counter group 0x7febccfd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075630838 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075630838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075630838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075630838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075630840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075630840 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075630849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075630849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:31.988672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10380): Terminating (SIGTERM) 07:56:32.030018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10383): Terminating (SIGTERM) 07:56:32.073420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10386): Terminating (SIGTERM) 07:56:32.115953 --- ParallelTerminationStrategy: PID 10380 died... 07:56:32.136521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10380): Terminated: ok {rc=0} 07:56:32.182807 --- ParallelTerminationStrategy: PID 10383 died... 07:56:32.203085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10383): Terminated: ok {rc=0} 07:56:32.250204 --- ParallelTerminationStrategy: PID 10386 died... 07:56:32.268888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10386): Terminated: ok {rc=0} 07:56:32.355747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:56:33.559427 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:33.567084 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:56:33.592338 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:56:33.619063 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:56:33.670909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:56:33.694627 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:56:33.721412 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:56:34.274687 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:56:34.324068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:34.335413 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:56:34.394555 tst mo_mt_call.py: using LAC 20034 07:56:34.511997 tst mo_mt_call.py: using RAC 144 07:56:34.630922 tst mo_mt_call.py: using CellId 20034 07:56:34.754321 tst mo_mt_call.py: using BVCI 20035 07:56:34.864302 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:34.875614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:34.886722 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:34.898304 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:34.909782 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:34.921121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:56:35.043045 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:56:35.164727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:35.666143 run create_hlr_db(pid=10392): Launched 07:56:35.799361 bus /sierra_2: Setting Powered False 07:56:36.864218 run create_hlr_db(pid=10392): Terminated: ok {rc=0} 07:56:37.297070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10394): Launched 07:56:37.599804 run osmo-hlr_10.42.42.2(pid=10395): Launched 07:56:37.714480 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:38.243277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10397): Launched 07:56:38.545488 run osmo-stp_10.42.42.5(pid=10398): Launched 07:56:38.659554 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:39.204822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10400): Launched 07:56:39.509070 run osmo-msc_10.42.42.6(pid=10401): Launched 07:56:39.678584 run osmo-stp_10.42.42.5(pid=10398): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10398)] 07:56:39.807305 run osmo-stp_10.42.42.5(pid=10398): stdout: | (launched: 2022-12-09_07:56:38.489917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:39.935455 run osmo-stp_10.42.42.5(pid=10398): stderr: | 20221209075638657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075638657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075638657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075638658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075638658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075638658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075638658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:40.062522 run osmo-stp_10.42.42.5(pid=10398): stdout: | (launched: 2022-12-09_07:56:38.489917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:40.182909 run osmo-stp_10.42.42.5(pid=10398): stderr: | 20221209075638657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075638657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075638657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075638658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075638658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075638658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075638658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:40.326997 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10398): Process ended prematurely: osmo-stp_10.42.42.5(pid=10398) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10398)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:56:40.335785 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:56:40.362313 run osmo-hlr_10.42.42.2(pid=10395): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10395)] 07:56:40.409994 run osmo-hlr_10.42.42.2(pid=10395): stdout: | (launched: 2022-12-09_07:56:37.544095) 07:56:40.459182 run osmo-hlr_10.42.42.2(pid=10395): stderr: | 20221209075637716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075637716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075637717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075637717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075637717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075637717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075637729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075637738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075637738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075637738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:40.527898 run osmo-msc_10.42.42.6(pid=10401): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10401)] 07:56:40.575291 run osmo-msc_10.42.42.6(pid=10401): stdout: | (launched: 2022-12-09_07:56:39.452549) 07:56:40.624380 run osmo-msc_10.42.42.6(pid=10401): stderr: | 20221209075639724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075639724 DLGLOBAL DEBUG validating counter group 0x7fb3bd045c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075639724 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075639724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075639725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075639725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075639726 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075639727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075639727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075639727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:40.673858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10394): Terminating (SIGTERM) 07:56:40.712926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10397): Terminating (SIGTERM) 07:56:40.752241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10400): Terminating (SIGTERM) 07:56:40.791675 --- ParallelTerminationStrategy: PID 10394 died... 07:56:40.810597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10394): Terminated: ok {rc=0} 07:56:40.854840 --- ParallelTerminationStrategy: PID 10397 died... 07:56:40.873282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10397): Terminated: ok {rc=0} 07:56:40.916608 --- ParallelTerminationStrategy: PID 10400 died... 07:56:40.934922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10400): Terminated: ok {rc=0} 07:56:41.019813 bus /sierra_3: Setting Powered False 07:56:42.119064 bus /sierra_3: Setting Powered False 07:56:43.232865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:56:44.380294 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:44.393039 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:56:44.456210 tst mo_mt_call_osmux.py: using LAC 20035 07:56:44.583518 tst mo_mt_call_osmux.py: using RAC 145 07:56:44.711329 tst mo_mt_call_osmux.py: using CellId 20035 07:56:44.838468 tst mo_mt_call_osmux.py: using BVCI 20036 07:56:44.957158 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:44.968889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:44.980566 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:44.992408 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:45.004107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:56:45.015872 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:56:45.133369 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:56:45.248208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:45.751220 run create_hlr_db(pid=10403): Launched 07:56:45.888431 bus /sierra_2: Setting Powered False 07:56:46.963302 run create_hlr_db(pid=10403): Terminated: ok {rc=0} 07:56:47.455031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10405): Launched 07:56:47.756901 run osmo-hlr_10.42.42.2(pid=10406): Launched 07:56:47.872056 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:48.393663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10408): Launched 07:56:48.696609 run osmo-stp_10.42.42.5(pid=10409): Launched 07:56:48.812545 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:49.359286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10411): Launched 07:56:49.662172 run osmo-msc_10.42.42.6(pid=10412): Launched 07:56:49.834515 run osmo-stp_10.42.42.5(pid=10409): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10409)] 07:56:49.962094 run osmo-stp_10.42.42.5(pid=10409): stdout: | (launched: 2022-12-09_07:56:48.640521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:50.089810 run osmo-stp_10.42.42.5(pid=10409): stderr: | 20221209075648807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075648808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075648808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075648808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075648809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075648809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075648809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:50.216353 run osmo-stp_10.42.42.5(pid=10409): stdout: | (launched: 2022-12-09_07:56:48.640521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:50.336625 run osmo-stp_10.42.42.5(pid=10409): stderr: | 20221209075648807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075648808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075648808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075648808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075648809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075648809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075648809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:50.481105 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10409): Process ended prematurely: osmo-stp_10.42.42.5(pid=10409) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10409)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:56:50.490053 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:56:50.517056 run osmo-hlr_10.42.42.2(pid=10406): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10406)] 07:56:50.564216 run osmo-hlr_10.42.42.2(pid=10406): stdout: | (launched: 2022-12-09_07:56:47.701375) 07:56:50.613191 run osmo-hlr_10.42.42.2(pid=10406): stderr: | 20221209075647875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075647875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075647875 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075647875 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075647875 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075647875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075647895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075647905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075647905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075647905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:50.681475 run osmo-msc_10.42.42.6(pid=10412): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10412)] 07:56:50.728465 run osmo-msc_10.42.42.6(pid=10412): stdout: | (launched: 2022-12-09_07:56:49.606169) 07:56:50.777379 run osmo-msc_10.42.42.6(pid=10412): stderr: | 20221209075649875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075649875 DLGLOBAL DEBUG validating counter group 0x7efee46eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075649875 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075649875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075649876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075649876 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075649878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075649878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075649878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075649878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:50.826551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10405): Terminating (SIGTERM) 07:56:50.865751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10408): Terminating (SIGTERM) 07:56:50.904759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10411): Terminating (SIGTERM) 07:56:50.944165 --- ParallelTerminationStrategy: PID 10405 died... 07:56:50.962877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10405): Terminated: ok {rc=0} 07:56:51.006516 --- ParallelTerminationStrategy: PID 10408 died... 07:56:51.024594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10408): Terminated: ok {rc=0} 07:56:51.067960 --- ParallelTerminationStrategy: PID 10411 died... 07:56:51.086211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10411): Terminated: ok {rc=0} 07:56:51.168628 bus /sierra_3: Setting Powered False 07:56:52.265950 bus /sierra_3: Setting Powered False 07:56:53.380703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:56:54.629381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:54.637404 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:56:54.662196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:56:54.690257 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:56:54.741898 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:56:54.766536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:56:54.794207 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:56:55.351163 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:56:55.402596 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:56:55.414429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:56:55.474579 tst mo_mt_call.py: using LAC 20036 07:56:55.599294 tst mo_mt_call.py: using RAC 146 07:56:55.723668 tst mo_mt_call.py: using CellId 20036 07:56:55.846747 tst mo_mt_call.py: using BVCI 20037 07:56:55.957790 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:56:55.969322 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:56:55.980651 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:56:55.992413 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:56:56.004216 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:56:56.016378 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:56:56.136214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:56:56.257987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:56.758641 run create_hlr_db(pid=10418): Launched 07:56:56.889629 bus /sierra_2: Setting Powered False 07:56:57.953744 run create_hlr_db(pid=10418): Terminated: ok {rc=0} 07:56:58.385205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Launched 07:56:58.710470 run osmo-hlr_10.42.42.2(pid=10421): Launched 07:56:58.833050 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:59.387413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Launched 07:56:59.712188 run osmo-stp_10.42.42.5(pid=10424): Launched 07:56:59.834738 run osmo-msc_10.42.42.6: Starting osmo-msc 07:57:00.421174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10426): Launched 07:57:00.743878 run osmo-msc_10.42.42.6(pid=10427): Launched 07:57:01.029644 run osmo-stp_10.42.42.5(pid=10424): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] 07:57:01.328153 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-09_07:56:59.653192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:01.532687 run osmo-stp_10.42.42.5(pid=10424): stderr: | 20221209075659842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075659843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075659843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075659843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075659844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075659844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075659844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:01.672173 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-09_07:56:59.653192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:01.804802 run osmo-stp_10.42.42.5(pid=10424): stderr: | 20221209075659842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075659843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075659843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075659843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075659844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075659844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075659844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:01.962950 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:57:01.972813 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:57:02.001195 run osmo-hlr_10.42.42.2(pid=10421): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10421)] 07:57:02.051749 run osmo-hlr_10.42.42.2(pid=10421): stdout: | (launched: 2022-12-09_07:56:58.651172) 07:57:02.104384 run osmo-hlr_10.42.42.2(pid=10421): stderr: | 20221209075658847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075658847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075658847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075658847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075658847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075658847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075658859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075658868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075658868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075658868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:02.177616 run osmo-msc_10.42.42.6(pid=10427): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10427)] 07:57:02.228082 run osmo-msc_10.42.42.6(pid=10427): stdout: | (launched: 2022-12-09_07:57:00.684707) 07:57:02.279811 run osmo-msc_10.42.42.6(pid=10427): stderr: | 20221209075701120 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075701120 DLGLOBAL DEBUG validating counter group 0x7fe392bfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075701120 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075701120 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075701121 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075701122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075701126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075701127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075701127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075701128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:57:02.331902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminating (SIGTERM) 07:57:02.373034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminating (SIGTERM) 07:57:02.414099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10426): Terminating (SIGTERM) 07:57:02.455799 --- ParallelTerminationStrategy: PID 10420 died... 07:57:02.475526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminated: ok {rc=0} 07:57:02.520899 --- ParallelTerminationStrategy: PID 10423 died... 07:57:02.540633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminated: ok {rc=0} 07:57:02.585978 --- ParallelTerminationStrategy: PID 10426 died... 07:57:02.605345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10426): Terminated: ok {rc=0} 07:57:02.691729 bus /sierra_3: Setting Powered False 07:57:03.789974 bus /sierra_3: Setting Powered False 07:57:04.905722 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:57:06.054550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:57:06.067018 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:57:06.128808 tst mo_mt_call_osmux.py: using LAC 20037 07:57:06.254380 tst mo_mt_call_osmux.py: using RAC 147 07:57:06.382580 tst mo_mt_call_osmux.py: using CellId 20037 07:57:06.509467 tst mo_mt_call_osmux.py: using BVCI 20038 07:57:06.620303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:57:06.631987 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:57:06.643482 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:57:06.655216 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:57:06.667103 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:57:06.678957 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:57:06.799812 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:57:06.919233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:07.387313 run create_hlr_db(pid=10429): Launched 07:57:07.502018 bus /sierra_2: Setting Powered False 07:57:08.562780 run create_hlr_db(pid=10429): Terminated: ok {rc=0} 07:57:08.982959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10431): Launched 07:57:09.285243 run osmo-hlr_10.42.42.2(pid=10432): Launched 07:57:09.400349 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:09.935249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10434): Launched 07:57:10.236934 run osmo-stp_10.42.42.5(pid=10435): Launched 07:57:10.352429 run osmo-msc_10.42.42.6: Starting osmo-msc 07:57:10.898826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10437): Launched 07:57:11.202152 run osmo-msc_10.42.42.6(pid=10438): Launched 07:57:11.371003 run osmo-stp_10.42.42.5(pid=10435): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10435)] 07:57:11.498196 run osmo-stp_10.42.42.5(pid=10435): stdout: | (launched: 2022-12-09_07:57:10.181195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:11.625936 run osmo-stp_10.42.42.5(pid=10435): stderr: | 20221209075710349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075710349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075710349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075710350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075710350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075710350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075710350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:11.752084 run osmo-stp_10.42.42.5(pid=10435): stdout: | (launched: 2022-12-09_07:57:10.181195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:11.872447 run osmo-stp_10.42.42.5(pid=10435): stderr: | 20221209075710349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075710349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075710349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075710350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075710350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075710350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075710350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:12.017255 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10435): Process ended prematurely: osmo-stp_10.42.42.5(pid=10435) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10435)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:57:12.026398 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:57:12.052733 run osmo-hlr_10.42.42.2(pid=10432): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10432)] 07:57:12.100563 run osmo-hlr_10.42.42.2(pid=10432): stdout: | (launched: 2022-12-09_07:57:09.229631) 07:57:12.149710 run osmo-hlr_10.42.42.2(pid=10432): stderr: | 20221209075709405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075709405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075709405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075709405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075709405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075709405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075709417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075709427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075709427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075709427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:12.218044 run osmo-msc_10.42.42.6(pid=10438): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10438)] 07:57:12.265299 run osmo-msc_10.42.42.6(pid=10438): stdout: | (launched: 2022-12-09_07:57:11.146429) 07:57:12.314292 run osmo-msc_10.42.42.6(pid=10438): stderr: | 20221209075711416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075711416 DLGLOBAL DEBUG validating counter group 0x7f3ff911ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075711416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075711416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075711416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075711417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075711418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075711419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075711419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075711419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:57:12.363536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10431): Terminating (SIGTERM) 07:57:12.402850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10434): Terminating (SIGTERM) 07:57:12.442315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10437): Terminating (SIGTERM) 07:57:12.482072 --- ParallelTerminationStrategy: PID 10431 died... 07:57:12.500697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10431): Terminated: ok {rc=0} 07:57:12.544759 --- ParallelTerminationStrategy: PID 10434 died... 07:57:12.563682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10434): Terminated: ok {rc=0} 07:57:12.606876 --- ParallelTerminationStrategy: PID 10437 died... 07:57:12.625162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10437): Terminated: ok {rc=0} 07:57:12.707924 bus /sierra_3: Setting Powered False 07:57:13.801981 bus /sierra_3: Setting Powered False 07:57:14.914107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:57:16.183968 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:57:16.193837 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:57:16.222423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:57:16.252272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:57:16.309814 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:57:16.342749 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:57:16.372293 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:57:16.953777 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:57:17.027497 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:17.044446 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:57:17.118612 tst mo_mt_call.py: using LAC 20038 07:57:17.253460 tst mo_mt_call.py: using RAC 148 07:57:17.373290 tst mo_mt_call.py: using CellId 20038 07:57:17.489927 tst mo_mt_call.py: using BVCI 20039 07:57:17.601475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:17.612797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:17.623939 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:17.635548 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:17.646739 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:17.658146 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:57:17.776200 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:57:17.891630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:18.361593 run create_hlr_db(pid=10443): Launched 07:57:18.475949 bus /sierra_2: Setting Powered False 07:57:19.537539 run create_hlr_db(pid=10443): Terminated: ok {rc=0} 07:57:19.979205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10445): Launched 07:57:20.303902 run osmo-hlr_10.42.42.2(pid=10446): Launched 07:57:20.427755 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:20.984433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10448): Launched 07:57:21.309404 run osmo-stp_10.42.42.5(pid=10449): Launched 07:57:21.433485 run osmo-msc_10.42.42.6: Starting osmo-msc 07:57:22.018812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10451): Launched 07:57:22.342651 run osmo-msc_10.42.42.6(pid=10452): Launched 07:57:22.525111 run osmo-stp_10.42.42.5(pid=10449): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10449)] 07:57:22.660824 run osmo-stp_10.42.42.5(pid=10449): stdout: | (launched: 2022-12-09_07:57:21.249354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:22.797836 run osmo-stp_10.42.42.5(pid=10449): stderr: | 20221209075721440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075721440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075721441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075721441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075721442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075721442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075721442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:22.933307 run osmo-stp_10.42.42.5(pid=10449): stdout: | (launched: 2022-12-09_07:57:21.249354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:23.062646 run osmo-stp_10.42.42.5(pid=10449): stderr: | 20221209075721440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075721440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075721441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075721441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075721442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075721442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075721442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:23.217075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10449): Process ended prematurely: osmo-stp_10.42.42.5(pid=10449) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10449)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:57:23.226584 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:57:23.254191 run osmo-hlr_10.42.42.2(pid=10446): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10446)] 07:57:23.303683 run osmo-hlr_10.42.42.2(pid=10446): stdout: | (launched: 2022-12-09_07:57:20.244692) 07:57:23.355019 run osmo-hlr_10.42.42.2(pid=10446): stderr: | 20221209075720441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075720441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075720441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075720441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075720441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075720441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075720454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075720462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075720462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075720462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:23.426436 run osmo-msc_10.42.42.6(pid=10452): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10452)] 07:57:23.476210 run osmo-msc_10.42.42.6(pid=10452): stdout: | (launched: 2022-12-09_07:57:22.282709) 07:57:23.527476 run osmo-msc_10.42.42.6(pid=10452): stderr: | 20221209075722603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075722603 DLGLOBAL DEBUG validating counter group 0x7fb0b57bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075722603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075722603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075722603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075722604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075722605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075722606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075722606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075722606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:57:23.578633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10445): Terminating (SIGTERM) 07:57:23.619540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10448): Terminating (SIGTERM) 07:57:23.660655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10451): Terminating (SIGTERM) 07:57:23.702507 --- ParallelTerminationStrategy: PID 10445 died... 07:57:23.722332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10445): Terminated: ok {rc=0} 07:57:23.768216 --- ParallelTerminationStrategy: PID 10448 died... 07:57:23.787848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10448): Terminated: ok {rc=0} 07:57:23.833525 --- ParallelTerminationStrategy: PID 10451 died... 07:57:23.853023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10451): Terminated: ok {rc=0} 07:57:23.939309 bus /sierra_3: Setting Powered False 07:57:25.037538 bus /sierra_3: Setting Powered False 07:57:26.152765 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:57:27.301640 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:27.314540 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:57:27.376705 tst mo_mt_call_osmux.py: using LAC 20039 07:57:27.504777 tst mo_mt_call_osmux.py: using RAC 149 07:57:27.631460 tst mo_mt_call_osmux.py: using CellId 20039 07:57:27.763822 tst mo_mt_call_osmux.py: using BVCI 20040 07:57:27.882890 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:27.894779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:27.906472 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:27.918212 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:27.929981 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:57:27.941635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:57:28.062490 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:57:28.180096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:28.650235 run create_hlr_db(pid=10454): Launched 07:57:28.767960 bus /sierra_2: Setting Powered False 07:57:29.828085 run create_hlr_db(pid=10454): Terminated: ok {rc=0} 07:57:30.249211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10456): Launched 07:57:30.552297 run osmo-hlr_10.42.42.2(pid=10457): Launched 07:57:30.667164 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:31.203739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10459): Launched 07:57:31.555879 run osmo-stp_10.42.42.5(pid=10460): Launched 07:57:31.816517 run osmo-msc_10.42.42.6: Starting osmo-msc 07:57:32.493176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10462): Launched 07:57:32.796655 run osmo-msc_10.42.42.6(pid=10463): Launched 07:57:32.966738 run osmo-stp_10.42.42.5(pid=10460): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10460)] 07:57:33.094885 run osmo-stp_10.42.42.5(pid=10460): stdout: | (launched: 2022-12-09_07:57:31.491623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:33.223169 run osmo-stp_10.42.42.5(pid=10460): stderr: | 20221209075731784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075731784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075731785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075731785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075731786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075731786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075731786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:33.349420 run osmo-stp_10.42.42.5(pid=10460): stdout: | (launched: 2022-12-09_07:57:31.491623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:33.470489 run osmo-stp_10.42.42.5(pid=10460): stderr: | 20221209075731784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075731784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075731785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075731785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075731786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075731786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075731786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:33.615416 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10460): Process ended prematurely: osmo-stp_10.42.42.5(pid=10460) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10460)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:57:33.624454 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:57:33.650980 run osmo-hlr_10.42.42.2(pid=10457): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10457)] 07:57:33.698683 run osmo-hlr_10.42.42.2(pid=10457): stdout: | (launched: 2022-12-09_07:57:30.496637) 07:57:33.747692 run osmo-hlr_10.42.42.2(pid=10457): stderr: | 20221209075730672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075730672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075730673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075730673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075730673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075730673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075730688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075730697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075730697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075730697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:33.816035 run osmo-msc_10.42.42.6(pid=10463): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10463)] 07:57:33.863293 run osmo-msc_10.42.42.6(pid=10463): stdout: | (launched: 2022-12-09_07:57:32.740613) 07:57:33.912152 run osmo-msc_10.42.42.6(pid=10463): stderr: | 20221209075733010 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075733010 DLGLOBAL DEBUG validating counter group 0x7f8447544c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075733010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075733010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075733010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075733010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075733012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075733012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075733013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075733013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:57:33.961471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10456): Terminating (SIGTERM) 07:57:34.000880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10459): Terminating (SIGTERM) 07:57:34.040152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10462): Terminating (SIGTERM) 07:57:34.079678 --- ParallelTerminationStrategy: PID 10456 died... 07:57:34.098620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10456): Terminated: ok {rc=0} 07:57:34.142338 --- ParallelTerminationStrategy: PID 10459 died... 07:57:34.160482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10459): Terminated: ok {rc=0} 07:57:34.203879 --- ParallelTerminationStrategy: PID 10462 died... 07:57:34.222146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10462): Terminated: ok {rc=0} 07:57:34.305187 bus /sierra_3: Setting Powered False 07:57:35.401013 bus /sierra_3: Setting Powered False 07:57:36.515011 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:57:37.754303 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:57:37.761770 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:57:37.786354 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:57:37.813234 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:57:37.866633 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:57:37.890857 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:57:37.917646 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:57:38.474794 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:57:38.528332 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:38.540337 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:57:38.601677 tst mo_mt_call.py: using LAC 20040 07:57:38.727959 tst mo_mt_call.py: using RAC 150 07:57:38.854109 tst mo_mt_call.py: using CellId 20040 07:57:38.980539 tst mo_mt_call.py: using BVCI 20041 07:57:39.099105 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:39.110958 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:39.122663 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:39.134285 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:39.146039 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:39.157723 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:57:39.273064 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:57:39.389716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:39.857356 run create_hlr_db(pid=10469): Launched 07:57:39.973585 bus /sierra_2: Setting Powered False 07:57:41.033678 run create_hlr_db(pid=10469): Terminated: ok {rc=0} 07:57:41.475150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10471): Launched 07:57:41.799021 run osmo-hlr_10.42.42.2(pid=10472): Launched 07:57:41.923249 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:42.482185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10474): Launched 07:57:42.808104 run osmo-stp_10.42.42.5(pid=10475): Launched 07:57:42.930422 run osmo-msc_10.42.42.6: Starting osmo-msc 07:57:43.515268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10477): Launched 07:57:43.841275 run osmo-msc_10.42.42.6(pid=10478): Launched 07:57:44.022671 run osmo-stp_10.42.42.5(pid=10475): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10475)] 07:57:44.162121 run osmo-stp_10.42.42.5(pid=10475): stdout: | (launched: 2022-12-09_07:57:42.748628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:44.298668 run osmo-stp_10.42.42.5(pid=10475): stderr: | 20221209075742939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075742939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075742939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075742939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075742940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075742940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075742940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:44.432685 run osmo-stp_10.42.42.5(pid=10475): stdout: | (launched: 2022-12-09_07:57:42.748628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:44.562166 run osmo-stp_10.42.42.5(pid=10475): stderr: | 20221209075742939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075742939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075742939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075742939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075742940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075742940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075742940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:44.716668 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10475): Process ended prematurely: osmo-stp_10.42.42.5(pid=10475) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10475)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:57:44.726306 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:57:44.753934 run osmo-hlr_10.42.42.2(pid=10472): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10472)] 07:57:44.803687 run osmo-hlr_10.42.42.2(pid=10472): stdout: | (launched: 2022-12-09_07:57:41.739971) 07:57:44.854991 run osmo-hlr_10.42.42.2(pid=10472): stderr: | 20221209075741935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075741935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075741935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075741935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075741935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075741935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075741952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075741962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075741962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075741962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:44.926742 run osmo-msc_10.42.42.6(pid=10478): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10478)] 07:57:44.976391 run osmo-msc_10.42.42.6(pid=10478): stdout: | (launched: 2022-12-09_07:57:43.781757) 07:57:45.027530 run osmo-msc_10.42.42.6(pid=10478): stderr: | 20221209075744102 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075744103 DLGLOBAL DEBUG validating counter group 0x7fc561967c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075744103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075744103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075744103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075744103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075744105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075744105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075744105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075744106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:57:45.079050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10471): Terminating (SIGTERM) 07:57:45.120358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10474): Terminating (SIGTERM) 07:57:45.161912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10477): Terminating (SIGTERM) 07:57:45.203710 --- ParallelTerminationStrategy: PID 10471 died... 07:57:45.223628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10471): Terminated: ok {rc=0} 07:57:45.269432 --- ParallelTerminationStrategy: PID 10474 died... 07:57:45.288594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10474): Terminated: ok {rc=0} 07:57:45.334476 --- ParallelTerminationStrategy: PID 10477 died... 07:57:45.353821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10477): Terminated: ok {rc=0} 07:57:45.440692 bus /sierra_3: Setting Powered False 07:57:46.547778 bus /sierra_3: Setting Powered False 07:57:47.666153 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:57:48.811039 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:48.823044 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:57:48.883661 tst mo_mt_call_osmux.py: using LAC 20041 07:57:49.002988 tst mo_mt_call_osmux.py: using RAC 151 07:57:49.126422 tst mo_mt_call_osmux.py: using CellId 20041 07:57:49.253761 tst mo_mt_call_osmux.py: using BVCI 20042 07:57:49.371178 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:49.383120 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:49.394947 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:49.406716 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:49.418699 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:57:49.430449 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:57:49.548329 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:57:49.669249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:50.170448 run create_hlr_db(pid=10480): Launched 07:57:50.303527 bus /sierra_2: Setting Powered False 07:57:51.367430 run create_hlr_db(pid=10480): Terminated: ok {rc=0} 07:57:51.798907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10482): Launched 07:57:52.117652 run osmo-hlr_10.42.42.2(pid=10483): Launched 07:57:52.232083 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:52.750931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10485): Launched 07:57:53.053951 run osmo-stp_10.42.42.5(pid=10486): Launched 07:57:53.171424 run osmo-msc_10.42.42.6: Starting osmo-msc 07:57:53.719191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10488): Launched 07:57:54.023736 run osmo-msc_10.42.42.6(pid=10489): Launched 07:57:54.193864 run osmo-stp_10.42.42.5(pid=10486): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10486)] 07:57:54.322244 run osmo-stp_10.42.42.5(pid=10486): stdout: | (launched: 2022-12-09_07:57:52.997947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:54.451592 run osmo-stp_10.42.42.5(pid=10486): stderr: | 20221209075753164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075753164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075753165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075753165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075753166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075753166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075753166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:54.579081 run osmo-stp_10.42.42.5(pid=10486): stdout: | (launched: 2022-12-09_07:57:52.997947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:54.700676 run osmo-stp_10.42.42.5(pid=10486): stderr: | 20221209075753164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075753164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075753165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075753165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075753166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075753166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075753166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:54.846041 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10486): Process ended prematurely: osmo-stp_10.42.42.5(pid=10486) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10486)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:57:54.854940 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:57:54.884003 run osmo-hlr_10.42.42.2(pid=10483): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10483)] 07:57:54.931653 run osmo-hlr_10.42.42.2(pid=10483): stdout: | (launched: 2022-12-09_07:57:52.062053) 07:57:54.981322 run osmo-hlr_10.42.42.2(pid=10483): stderr: | 20221209075752236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075752236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075752236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075752236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075752236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075752236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075752248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075752257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075752258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075752258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:55.050268 run osmo-msc_10.42.42.6(pid=10489): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10489)] 07:57:55.098008 run osmo-msc_10.42.42.6(pid=10489): stdout: | (launched: 2022-12-09_07:57:53.967036) 07:57:55.147356 run osmo-msc_10.42.42.6(pid=10489): stderr: | 20221209075754237 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075754238 DLGLOBAL DEBUG validating counter group 0x7f12418abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075754238 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075754238 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075754238 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075754238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075754240 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075754240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075754240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075754241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:57:55.197218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10482): Terminating (SIGTERM) 07:57:55.237141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10485): Terminating (SIGTERM) 07:57:55.277036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10488): Terminating (SIGTERM) 07:57:55.317506 --- ParallelTerminationStrategy: PID 10482 died... 07:57:55.336397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10482): Terminated: ok {rc=0} 07:57:55.381401 --- ParallelTerminationStrategy: PID 10485 died... 07:57:55.399742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10485): Terminated: ok {rc=0} 07:57:55.444791 --- ParallelTerminationStrategy: PID 10488 died... 07:57:55.463672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10488): Terminated: ok {rc=0} 07:57:55.549644 bus /sierra_3: Setting Powered False 07:57:56.648391 bus /sierra_3: Setting Powered False 07:57:57.761664 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:57:59.002269 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:57:59.009594 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:57:59.033919 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:57:59.061137 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:57:59.112344 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:57:59.136430 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:57:59.163544 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:57:59.720789 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:57:59.770975 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:57:59.782391 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:57:59.842016 tst mo_mt_call.py: using LAC 20042 07:57:59.959706 tst mo_mt_call.py: using RAC 152 07:58:00.079564 tst mo_mt_call.py: using CellId 20042 07:58:00.208888 tst mo_mt_call.py: using BVCI 20043 07:58:00.326286 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:00.338506 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:00.350515 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:00.362482 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:00.375410 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:00.387723 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:58:00.509889 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:58:00.626376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:01.123173 run create_hlr_db(pid=10494): Launched 07:58:01.319915 bus /sierra_2: Setting Powered False 07:58:02.379953 run create_hlr_db(pid=10494): Terminated: ok {rc=0} 07:58:02.853135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10496): Launched 07:58:03.176759 run osmo-hlr_10.42.42.2(pid=10497): Launched 07:58:03.299311 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:03.858902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10499): Launched 07:58:04.184204 run osmo-stp_10.42.42.5(pid=10500): Launched 07:58:04.306911 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:04.898399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10502): Launched 07:58:05.225114 run osmo-msc_10.42.42.6(pid=10503): Launched 07:58:05.406983 run osmo-stp_10.42.42.5(pid=10500): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10500)] 07:58:05.543274 run osmo-stp_10.42.42.5(pid=10500): stdout: | (launched: 2022-12-09_07:58:04.124371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:05.679569 run osmo-stp_10.42.42.5(pid=10500): stderr: | 20221209075804314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075804314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075804315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075804315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075804316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075804316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075804316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:05.814445 run osmo-stp_10.42.42.5(pid=10500): stdout: | (launched: 2022-12-09_07:58:04.124371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:05.943326 run osmo-stp_10.42.42.5(pid=10500): stderr: | 20221209075804314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075804314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075804315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075804315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075804316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075804316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075804316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:06.097706 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10500): Process ended prematurely: osmo-stp_10.42.42.5(pid=10500) [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10500)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:58:06.107499 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:58:06.135300 run osmo-hlr_10.42.42.2(pid=10497): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10497)] 07:58:06.185159 run osmo-hlr_10.42.42.2(pid=10497): stdout: | (launched: 2022-12-09_07:58:03.117445) 07:58:06.236496 run osmo-hlr_10.42.42.2(pid=10497): stderr: | 20221209075803312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075803313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075803313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075803313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075803313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075803313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075803325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075803333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075803334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075803334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:06.307941 run osmo-msc_10.42.42.6(pid=10503): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10503)] 07:58:06.357342 run osmo-msc_10.42.42.6(pid=10503): stdout: | (launched: 2022-12-09_07:58:05.165752) 07:58:06.408438 run osmo-msc_10.42.42.6(pid=10503): stderr: | 20221209075805486 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075805486 DLGLOBAL DEBUG validating counter group 0x7f302575ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075805486 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075805486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075805486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075805486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075805488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075805489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075805489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075805489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:06.460183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10496): Terminating (SIGTERM) 07:58:06.501447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10499): Terminating (SIGTERM) 07:58:06.543003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10502): Terminating (SIGTERM) 07:58:06.584764 --- ParallelTerminationStrategy: PID 10496 died... 07:58:06.604603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10496): Terminated: ok {rc=0} 07:58:06.650575 --- ParallelTerminationStrategy: PID 10499 died... 07:58:06.670111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10499): Terminated: ok {rc=0} 07:58:06.715663 --- ParallelTerminationStrategy: PID 10502 died... 07:58:06.735354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10502): Terminated: ok {rc=0} 07:58:06.822994 bus /sierra_3: Setting Powered False 07:58:07.922008 bus /sierra_3: Setting Powered False 07:58:09.040683 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:58:10.189472 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:10.202268 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:58:10.264214 tst mo_mt_call_osmux.py: using LAC 20043 07:58:10.394074 tst mo_mt_call_osmux.py: using RAC 153 07:58:10.521238 tst mo_mt_call_osmux.py: using CellId 20043 07:58:10.645727 tst mo_mt_call_osmux.py: using BVCI 20044 07:58:10.756809 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:10.768656 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:10.780084 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:10.791705 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:10.803423 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:58:10.815015 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:58:10.934414 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:58:11.053078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:11.522464 run create_hlr_db(pid=10505): Launched 07:58:11.639803 bus /sierra_2: Setting Powered False 07:58:12.699262 run create_hlr_db(pid=10505): Terminated: ok {rc=0} 07:58:13.121155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10507): Launched 07:58:13.423755 run osmo-hlr_10.42.42.2(pid=10508): Launched 07:58:13.540074 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:14.069603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10510): Launched 07:58:14.371652 run osmo-stp_10.42.42.5(pid=10511): Launched 07:58:14.487530 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:15.036695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10513): Launched 07:58:15.341724 run osmo-msc_10.42.42.6(pid=10514): Launched 07:58:15.510120 run osmo-stp_10.42.42.5(pid=10511): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10511)] 07:58:15.638278 run osmo-stp_10.42.42.5(pid=10511): stdout: | (launched: 2022-12-09_07:58:14.316018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:15.765594 run osmo-stp_10.42.42.5(pid=10511): stderr: | 20221209075814484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075814485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075814485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075814485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075814486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075814486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075814486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:15.901861 run osmo-stp_10.42.42.5(pid=10511): stdout: | (launched: 2022-12-09_07:58:14.316018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:16.025717 run osmo-stp_10.42.42.5(pid=10511): stderr: | 20221209075814484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075814485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075814485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075814485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075814486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075814486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075814486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:16.173544 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10511): Process ended prematurely: osmo-stp_10.42.42.5(pid=10511) [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10511)] [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:58:16.183801 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:58:16.212930 run osmo-hlr_10.42.42.2(pid=10508): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10508)] 07:58:16.263267 run osmo-hlr_10.42.42.2(pid=10508): stdout: | (launched: 2022-12-09_07:58:13.367994) 07:58:16.315078 run osmo-hlr_10.42.42.2(pid=10508): stderr: | 20221209075813544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075813544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075813544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075813544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075813544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075813544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075813556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075813564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075813565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075813565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:16.386936 run osmo-msc_10.42.42.6(pid=10514): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10514)] 07:58:16.437284 run osmo-msc_10.42.42.6(pid=10514): stdout: | (launched: 2022-12-09_07:58:15.284856) 07:58:16.493059 run osmo-msc_10.42.42.6(pid=10514): stderr: | 20221209075815557 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075815557 DLGLOBAL DEBUG validating counter group 0x7fdc9ab5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075815557 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075815557 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075815557 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075815558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075815560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075815560 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075815560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075815560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:16.579343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10507): Terminating (SIGTERM) 07:58:16.631338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10510): Terminating (SIGTERM) 07:58:16.672577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10513): Terminating (SIGTERM) 07:58:16.739928 --- ParallelTerminationStrategy: PID 10507 died... 07:58:16.766309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10507): Terminated: ok {rc=0} 07:58:16.819994 --- ParallelTerminationStrategy: PID 10510 died... 07:58:16.851416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10510): Terminated: ok {rc=0} 07:58:16.920312 --- ParallelTerminationStrategy: PID 10513 died... 07:58:16.940130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10513): Terminated: ok {rc=0} 07:58:17.027988 bus /sierra_3: Setting Powered False 07:58:18.124604 bus /sierra_3: Setting Powered False 07:58:19.238567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:nanobts+band-1900 --------------------------------------------------------------------- 07:58:20.479737 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:20.485405 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:58:20.510098 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:58:20.537495 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 07:58:20.622342 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:58:20.646399 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:58:20.674465 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 07:58:21.258664 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 07:58:21.264010 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.274942 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:58:21.314009 tst emergency_mo_mt_call.py: using LAC 20044 07:58:21.433058 tst emergency_mo_mt_call.py: using RAC 154 07:58:21.559044 tst emergency_mo_mt_call.py: using CellId 20044 07:58:21.686328 tst emergency_mo_mt_call.py: using BVCI 20045 07:58:21.803617 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.815169 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.826604 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.838269 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.849882 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.861288 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:21.976528 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:22.092331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:22.551976 run create_hlr_db(pid=10532): Launched 07:58:22.665969 bus /sierra_2: Setting Powered False 07:58:23.724868 run create_hlr_db(pid=10532): Terminated: ok {rc=0} 07:58:24.158604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10534): Launched 07:58:24.478543 run osmo-hlr_10.42.42.2(pid=10535): Launched 07:58:24.602806 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:25.153597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10537): Launched 07:58:25.473895 run osmo-stp_10.42.42.5(pid=10538): Launched 07:58:25.604555 tst emergency_mo_mt_call.py: using MSISDN 7096 07:58:25.768094 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:26.343661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10540): Launched 07:58:26.663555 run osmo-msc_10.42.42.6(pid=10541): Launched 07:58:26.842585 run osmo-stp_10.42.42.5(pid=10538): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] 07:58:26.976854 run osmo-stp_10.42.42.5(pid=10538): stdout: | (launched: 2022-12-09_07:58:25.414450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:27.111666 run osmo-stp_10.42.42.5(pid=10538): stderr: | 20221209075825606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075825606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075825606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075825607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075825607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075825607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075825607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:27.245509 run osmo-stp_10.42.42.5(pid=10538): stdout: | (launched: 2022-12-09_07:58:25.414450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:27.372123 run osmo-stp_10.42.42.5(pid=10538): stderr: | 20221209075825606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075825606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075825606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075825607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075825607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075825607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075825607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:27.523933 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10538): Process ended prematurely: osmo-stp_10.42.42.5(pid=10538) [trial-2356↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] [trial-2356↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 07:58:27.533331 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 07:58:27.561079 run osmo-hlr_10.42.42.2(pid=10535): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10535)] 07:58:27.611142 run osmo-hlr_10.42.42.2(pid=10535): stdout: | (launched: 2022-12-09_07:58:24.419587) 07:58:27.662956 run osmo-hlr_10.42.42.2(pid=10535): stderr: | 20221209075824615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075824615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075824615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075824615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075824615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075824615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075824627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075824636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075824636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075824636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:27.734967 run osmo-msc_10.42.42.6(pid=10541): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10541)] 07:58:27.784767 run osmo-msc_10.42.42.6(pid=10541): stdout: | (launched: 2022-12-09_07:58:26.604479) 07:58:27.836166 run osmo-msc_10.42.42.6(pid=10541): stderr: | 20221209075826923 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075826924 DLGLOBAL DEBUG validating counter group 0x7f5ed3313c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075826924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075826924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075826924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075826924 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075826926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075826926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075826926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075826927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:27.887726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10534): Terminating (SIGTERM) 07:58:27.929164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10537): Terminating (SIGTERM) 07:58:27.970889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10540): Terminating (SIGTERM) 07:58:28.012926 --- ParallelTerminationStrategy: PID 10534 died... 07:58:28.032833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10534): Terminated: ok {rc=0} 07:58:28.079091 --- ParallelTerminationStrategy: PID 10537 died... 07:58:28.098775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10537): Terminated: ok {rc=0} 07:58:28.144754 --- ParallelTerminationStrategy: PID 10540 died... 07:58:28.164278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10540): Terminated: ok {rc=0} 07:58:28.250767 bus /sierra_3: Setting Powered False 07:58:29.350219 bus /sierra_3: Setting Powered False 07:58:30.464499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 07:58:31.562726 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:31.577753 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:58:31.626158 tst emergency_preemptive_call.py: using LAC 20045 07:58:31.746848 tst emergency_preemptive_call.py: using RAC 155 07:58:31.874369 tst emergency_preemptive_call.py: using CellId 20045 07:58:32.025215 tst emergency_preemptive_call.py: using BVCI 20046 07:58:32.181647 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:32.192656 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:32.211178 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:32.225027 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:32.242978 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:32.256341 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:32.374843 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:32.495703 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:32.614237 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:32.732767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:33.229335 run create_hlr_db(pid=10543): Launched 07:58:33.359961 bus /sierra_2: Setting Powered False 07:58:34.423857 run create_hlr_db(pid=10543): Terminated: ok {rc=0} 07:58:34.850658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Launched 07:58:35.151173 run osmo-hlr_10.42.42.2(pid=10546): Launched 07:58:35.264339 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:35.791116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Launched 07:58:36.088407 run osmo-stp_10.42.42.5(pid=10549): Launched 07:58:36.211498 tst emergency_preemptive_call.py: using MSISDN 7097 07:58:36.362567 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:36.896672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10551): Launched 07:58:37.194605 run osmo-msc_10.42.42.6(pid=10552): Launched 07:58:37.361313 run osmo-stp_10.42.42.5(pid=10549): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] 07:58:37.488792 run osmo-stp_10.42.42.5(pid=10549): stdout: | (launched: 2022-12-09_07:58:36.033376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:37.615609 run osmo-stp_10.42.42.5(pid=10549): stderr: | 20221209075836202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075836202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075836202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075836203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075836203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075836203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075836203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:37.740416 run osmo-stp_10.42.42.5(pid=10549): stdout: | (launched: 2022-12-09_07:58:36.033376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:37.859078 run osmo-stp_10.42.42.5(pid=10549): stderr: | 20221209075836202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075836202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075836202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075836203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075836203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075836203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075836203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:38.001064 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10549): Process ended prematurely: osmo-stp_10.42.42.5(pid=10549) [trial-2356↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] [trial-2356↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 07:58:38.009706 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:58:38.036644 run osmo-hlr_10.42.42.2(pid=10546): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10546)] 07:58:38.084281 run osmo-hlr_10.42.42.2(pid=10546): stdout: | (launched: 2022-12-09_07:58:35.095792) 07:58:38.133511 run osmo-hlr_10.42.42.2(pid=10546): stderr: | 20221209075835269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075835269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075835269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075835269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075835269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075835269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075835282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075835291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075835291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075835291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:38.202350 run osmo-msc_10.42.42.6(pid=10552): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10552)] 07:58:38.250053 run osmo-msc_10.42.42.6(pid=10552): stdout: | (launched: 2022-12-09_07:58:37.139432) 07:58:38.299336 run osmo-msc_10.42.42.6(pid=10552): stderr: | 20221209075837407 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209075837408 DLGLOBAL DEBUG validating counter group 0x7fed3869cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209075837408 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209075837408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209075837408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209075837408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209075837410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209075837410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209075837411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209075837411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:38.349055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Terminating (SIGTERM) 07:58:38.388596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Terminating (SIGTERM) 07:58:38.428543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10551): Terminating (SIGTERM) 07:58:38.468670 --- ParallelTerminationStrategy: PID 10545 died... 07:58:38.487757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Terminated: ok {rc=0} 07:58:38.531911 --- ParallelTerminationStrategy: PID 10548 died... 07:58:38.550953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Terminated: ok {rc=0} 07:58:38.595230 --- ParallelTerminationStrategy: PID 10551 died... 07:58:38.613900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10551): Terminated: ok {rc=0} 07:58:38.699674 bus /sierra_9: Setting Powered False 07:58:39.798799 bus /sierra_9: Setting Powered False 07:58:40.913101 bus /sierra_8: Setting Powered False 07:58:42.013991 bus /sierra_8: Setting Powered False 07:58:43.130881 bus /sierra_3: Setting Powered False 07:58:44.227278 bus /sierra_3: Setting Powered False 07:58:45.342749 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-1900 --------------------------------------------------------------------- 07:58:46.633098 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:46.638898 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:58:46.663925 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 07:58:46.705653 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 07:58:46.798161 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:58:46.824140 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 07:58:46.864174 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 07:58:47.457299 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 07:58:47.510441 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:47.521791 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:58:47.561913 tst cs_paging_gprs_active.py: using LAC 20046 07:58:47.690671 tst cs_paging_gprs_active.py: using RAC 156 07:58:47.819561 tst cs_paging_gprs_active.py: using CellId 20046 07:58:47.946703 tst cs_paging_gprs_active.py: using BVCI 20047 07:58:48.066166 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.077610 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.088660 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.099788 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.110899 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.121964 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.133269 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.144188 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:58:48.155369 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:48.273496 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:58:48.391386 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:58:48.595769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:48.900623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10557): Launched 07:58:49.165504 run iperf3-srv_10.42.42.10(pid=10558): Launched 07:58:49.279741 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:58:49.482906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:49.786850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10559): Launched 07:58:50.053048 run iperf3-srv_10.42.42.10(pid=10560): Launched 07:58:50.167299 tst cs_paging_gprs_active.py:38: start network... 07:58:50.370600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:50.840828 run create_hlr_db(pid=10561): Launched 07:58:50.957926 bus /sierra_2: Setting Powered False 07:58:52.018588 run create_hlr_db(pid=10561): Terminated: ok {rc=0} 07:58:52.441230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10563): Launched 07:58:52.746196 run osmo-hlr_10.42.42.2(pid=10564): Launched 07:58:52.862264 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:53.398420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10566): Launched 07:58:53.702899 run osmo-stp_10.42.42.5(pid=10567): Launched 07:58:53.818959 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:54.343443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10569): Launched 07:58:54.459604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:54.718514 run patchelf(pid=10570): Launched 07:58:54.888344 run osmo-stp_10.42.42.5(pid=10567): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10567)] 07:58:55.017455 run osmo-stp_10.42.42.5(pid=10567): stdout: | (launched: 2022-12-09_07:58:53.646830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:55.148430 run osmo-stp_10.42.42.5(pid=10567): stderr: | 20221209075853813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075853813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075853813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075853814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075853814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075853814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075853814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:55.279088 run osmo-stp_10.42.42.5(pid=10567): stdout: | (launched: 2022-12-09_07:58:53.646830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:55.404425 run osmo-stp_10.42.42.5(pid=10567): stderr: | 20221209075853813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075853813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075853813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075853814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075853814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075853814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075853814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:55.552826 run patchelf(pid=10570): Terminating (SIGINT) 07:58:55.722940 run patchelf(pid=10570): Terminated: ok {rc=0} 07:58:55.846440 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10567): Process ended prematurely: osmo-stp_10.42.42.5(pid=10567) [trial-2356↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10567)] [trial-2356↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 07:58:55.856110 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:58:55.883947 run osmo-hlr_10.42.42.2(pid=10564): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10564)] 07:58:55.931937 run osmo-hlr_10.42.42.2(pid=10564): stdout: | (launched: 2022-12-09_07:58:52.689335) 07:58:55.981503 run osmo-hlr_10.42.42.2(pid=10564): stderr: | 20221209075852863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075852863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075852863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075852863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075852863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075852863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075852875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075852883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075852884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075852884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:56.031767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10557): Terminating (SIGTERM) 07:58:56.071386 run iperf3-srv_10.42.42.10(pid=10558): Terminating (SIGTERM) 07:58:56.111150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10559): Terminating (SIGTERM) 07:58:56.150883 run iperf3-srv_10.42.42.10(pid=10560): Terminating (SIGTERM) 07:58:56.190533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10563): Terminating (SIGTERM) 07:58:56.230301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10566): Terminating (SIGTERM) 07:58:56.270008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10569): Terminating (SIGTERM) 07:58:56.309991 --- ParallelTerminationStrategy: PID 10557 died... 07:58:56.329023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10557): Terminated: ok {rc=0} 07:58:56.373456 --- ParallelTerminationStrategy: PID 10558 died... 07:58:56.391898 run iperf3-srv_10.42.42.10(pid=10558): Terminated {rc=256} 07:58:56.435611 --- ParallelTerminationStrategy: PID 10559 died... 07:58:56.454027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10559): Terminated: ok {rc=0} 07:58:56.497647 --- ParallelTerminationStrategy: PID 10560 died... 07:58:56.515926 run iperf3-srv_10.42.42.10(pid=10560): Terminated {rc=256} 07:58:56.559896 --- ParallelTerminationStrategy: PID 10563 died... 07:58:56.578337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10563): Terminated: ok {rc=0} 07:58:56.622069 --- ParallelTerminationStrategy: PID 10566 died... 07:58:56.640697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10566): Terminated: ok {rc=0} 07:58:56.684715 --- ParallelTerminationStrategy: PID 10569 died... 07:58:56.703421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10569): Terminated: ok {rc=0} 07:58:56.787570 bus /gobi_0: Setting Powered False 07:58:57.886409 bus /gobi_0: Setting Powered False 07:58:59.004803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 07:59:00.150813 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.162529 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:59:00.202781 tst iperf3.py: using LAC 20047 07:59:00.324100 tst iperf3.py: using RAC 157 07:59:00.446736 tst iperf3.py: using CellId 20047 07:59:00.566193 tst iperf3.py: using BVCI 20048 07:59:00.678434 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.689419 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.700273 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.711613 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.722630 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.733732 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.744920 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.756093 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:00.767378 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:00.895983 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:59:01.109360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:01.427666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10571): Launched 07:59:01.718739 run iperf3-srv_10.42.42.10(pid=10572): Launched 07:59:01.850070 tst iperf3.py:8: start network... 07:59:02.058374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:02.533274 run create_hlr_db(pid=10573): Launched 07:59:02.649083 bus /gobi_6: Setting Powered False 07:59:03.709746 run create_hlr_db(pid=10573): Terminated: ok {rc=0} 07:59:04.150987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10575): Launched 07:59:04.476012 run osmo-hlr_10.42.42.2(pid=10576): Launched 07:59:04.599794 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:05.155401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10578): Launched 07:59:05.478911 run osmo-stp_10.42.42.5(pid=10579): Launched 07:59:05.604610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:06.166344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10581): Launched 07:59:06.290948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:06.567835 run patchelf(pid=10582): Launched 07:59:06.750457 run osmo-stp_10.42.42.5(pid=10579): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10579)] 07:59:06.887657 run osmo-stp_10.42.42.5(pid=10579): stdout: | (launched: 2022-12-09_07:59:05.419723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:07.026490 run osmo-stp_10.42.42.5(pid=10579): stderr: | 20221209075905610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075905610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075905610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075905611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075905611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075905611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075905611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:07.165621 run osmo-stp_10.42.42.5(pid=10579): stdout: | (launched: 2022-12-09_07:59:05.419723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:07.299216 run osmo-stp_10.42.42.5(pid=10579): stderr: | 20221209075905610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075905610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075905610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075905611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075905611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075905611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075905611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:07.457304 run patchelf(pid=10582): Terminating (SIGINT) 07:59:07.639350 run patchelf(pid=10582): Terminated: ok {rc=0} 07:59:07.769880 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10579): Process ended prematurely: osmo-stp_10.42.42.5(pid=10579) [trial-2356↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10579)] [trial-2356↪gprs:nanobts+band-1900↪iperf3.py:8] 07:59:07.780046 tst iperf3.py:8: Test FAILED (7.7 sec) 07:59:07.808616 run osmo-hlr_10.42.42.2(pid=10576): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10576)] 07:59:07.858306 run osmo-hlr_10.42.42.2(pid=10576): stdout: | (launched: 2022-12-09_07:59:04.416503) 07:59:07.909964 run osmo-hlr_10.42.42.2(pid=10576): stderr: | 20221209075904615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075904615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075904615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075904616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075904616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075904616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075904628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075904636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075904636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075904636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:07.961992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10571): Terminating (SIGTERM) 07:59:08.003495 run iperf3-srv_10.42.42.10(pid=10572): Terminating (SIGTERM) 07:59:08.044794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10575): Terminating (SIGTERM) 07:59:08.086425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10578): Terminating (SIGTERM) 07:59:08.127981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10581): Terminating (SIGTERM) 07:59:08.169856 --- ParallelTerminationStrategy: PID 10571 died... 07:59:08.189880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10571): Terminated: ok {rc=0} 07:59:08.235777 --- ParallelTerminationStrategy: PID 10572 died... 07:59:08.255286 run iperf3-srv_10.42.42.10(pid=10572): Terminated {rc=256} 07:59:08.300902 --- ParallelTerminationStrategy: PID 10575 died... 07:59:08.320381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10575): Terminated: ok {rc=0} 07:59:08.365995 --- ParallelTerminationStrategy: PID 10578 died... 07:59:08.385498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10578): Terminated: ok {rc=0} 07:59:08.431371 --- ParallelTerminationStrategy: PID 10581 died... 07:59:08.450991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10581): Terminated: ok {rc=0} 07:59:08.539209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 07:59:09.685987 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:09.697652 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:59:09.738063 tst iperf3m4.py: using LAC 20048 07:59:09.863830 tst iperf3m4.py: using RAC 158 07:59:09.982707 tst iperf3m4.py: using CellId 20048 07:59:10.100466 tst iperf3m4.py: using BVCI 20049 07:59:10.210947 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.222029 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.232783 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.244462 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.255964 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.267479 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.279243 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.290780 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:10.302413 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:10.423573 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:10.544701 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:10.663601 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:10.784574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:59:11.004294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:11.332886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10583): Launched 07:59:11.616734 run iperf3-srv_10.42.42.10(pid=10584): Launched 07:59:11.738482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:59:11.957498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:12.284116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10585): Launched 07:59:12.567227 run iperf3-srv_10.42.42.10(pid=10586): Launched 07:59:12.681694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:59:12.885504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:13.190481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10587): Launched 07:59:13.455098 run iperf3-srv_10.42.42.10(pid=10588): Launched 07:59:13.569878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:59:13.773432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:14.078800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10589): Launched 07:59:14.342656 run iperf3-srv_10.42.42.10(pid=10590): Launched 07:59:14.458481 tst iperf3m4.py:8: start network... 07:59:14.662247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:15.132495 run create_hlr_db(pid=10591): Launched 07:59:15.247735 bus /gobi_6: Setting Powered False 07:59:16.318726 run create_hlr_db(pid=10591): Terminated: ok {rc=0} 07:59:16.877764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10593): Launched 07:59:17.217486 run osmo-hlr_10.42.42.2(pid=10594): Launched 07:59:17.363656 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:17.930795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10596): Launched 07:59:18.258158 run osmo-stp_10.42.42.5(pid=10597): Launched 07:59:18.382450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:18.946502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10599): Launched 07:59:19.072594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:19.349717 run patchelf(pid=10600): Launched 07:59:19.532717 run osmo-stp_10.42.42.5(pid=10597): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10597)] 07:59:19.669743 run osmo-stp_10.42.42.5(pid=10597): stdout: | (launched: 2022-12-09_07:59:18.197940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:19.808261 run osmo-stp_10.42.42.5(pid=10597): stderr: | 20221209075918387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075918387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075918387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075918388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075918388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075918388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075918388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:19.946992 run osmo-stp_10.42.42.5(pid=10597): stdout: | (launched: 2022-12-09_07:59:18.197940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:20.079732 run osmo-stp_10.42.42.5(pid=10597): stderr: | 20221209075918387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075918387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075918387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075918388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075918388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075918388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075918388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:20.237177 run patchelf(pid=10600): Terminating (SIGINT) 07:59:20.418800 run patchelf(pid=10600): Terminated: ok {rc=0} 07:59:20.550031 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10597): Process ended prematurely: osmo-stp_10.42.42.5(pid=10597) [trial-2356↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10597)] [trial-2356↪gprs:nanobts+band-1900↪iperf3m4.py:8] 07:59:20.560328 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:59:20.589079 run osmo-hlr_10.42.42.2(pid=10594): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10594)] 07:59:20.638994 run osmo-hlr_10.42.42.2(pid=10594): stdout: | (launched: 2022-12-09_07:59:17.156356) 07:59:20.690831 run osmo-hlr_10.42.42.2(pid=10594): stderr: | 20221209075917398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075917398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075917398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075917398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075917398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075917398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075917409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075917418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075917419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075917419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:20.743354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10583): Terminating (SIGTERM) 07:59:20.785050 run iperf3-srv_10.42.42.10(pid=10584): Terminating (SIGTERM) 07:59:20.826756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10585): Terminating (SIGTERM) 07:59:20.868678 run iperf3-srv_10.42.42.10(pid=10586): Terminating (SIGTERM) 07:59:20.910416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10587): Terminating (SIGTERM) 07:59:20.952363 run iperf3-srv_10.42.42.10(pid=10588): Terminating (SIGTERM) 07:59:20.994022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10589): Terminating (SIGTERM) 07:59:21.035900 run iperf3-srv_10.42.42.10(pid=10590): Terminating (SIGTERM) 07:59:21.077571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10593): Terminating (SIGTERM) 07:59:21.119418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10596): Terminating (SIGTERM) 07:59:21.161339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10599): Terminating (SIGTERM) 07:59:21.203311 --- ParallelTerminationStrategy: PID 10583 died... 07:59:21.223326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10583): Terminated: ok {rc=0} 07:59:21.269909 --- ParallelTerminationStrategy: PID 10584 died... 07:59:21.289529 run iperf3-srv_10.42.42.10(pid=10584): Terminated {rc=256} 07:59:21.335776 --- ParallelTerminationStrategy: PID 10585 died... 07:59:21.355506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10585): Terminated: ok {rc=0} 07:59:21.401119 --- ParallelTerminationStrategy: PID 10586 died... 07:59:21.420359 run iperf3-srv_10.42.42.10(pid=10586): Terminated {rc=256} 07:59:21.466055 --- ParallelTerminationStrategy: PID 10587 died... 07:59:21.485721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10587): Terminated: ok {rc=0} 07:59:21.531820 --- ParallelTerminationStrategy: PID 10588 died... 07:59:21.551417 run iperf3-srv_10.42.42.10(pid=10588): Terminated {rc=256} 07:59:21.597197 --- ParallelTerminationStrategy: PID 10589 died... 07:59:21.616678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10589): Terminated: ok {rc=0} 07:59:21.662800 --- ParallelTerminationStrategy: PID 10590 died... 07:59:21.682654 run iperf3-srv_10.42.42.10(pid=10590): Terminated {rc=256} 07:59:21.728402 --- ParallelTerminationStrategy: PID 10593 died... 07:59:21.747931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10593): Terminated: ok {rc=0} 07:59:21.793770 --- ParallelTerminationStrategy: PID 10596 died... 07:59:21.813327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10596): Terminated: ok {rc=0} 07:59:21.859137 --- ParallelTerminationStrategy: PID 10599 died... 07:59:21.878738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10599): Terminated: ok {rc=0} 07:59:21.966200 bus /gobi_4: Setting Powered False 07:59:23.066175 bus /gobi_4: Setting Powered False 07:59:24.183320 bus /gobi_1: Setting Powered False 07:59:25.280177 bus /gobi_1: Setting Powered False 07:59:26.395964 bus /gobi_0: Setting Powered False 07:59:27.492654 bus /gobi_0: Setting Powered False 07:59:28.608337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 07:59:29.711327 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:29.723576 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:59:29.764445 tst ping.py: using LAC 20049 07:59:29.892013 tst ping.py: using RAC 159 07:59:30.017120 tst ping.py: using CellId 20049 07:59:30.142471 tst ping.py: using BVCI 20050 07:59:30.260309 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.271704 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.283015 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.294233 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.305346 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.316467 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.327759 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:30.339042 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:30.458835 tst ping.py:19: start network... 07:59:30.674023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:31.175892 run create_hlr_db(pid=10601): Launched 07:59:31.332674 bus /gobi_6: Setting Powered False 07:59:32.394452 run create_hlr_db(pid=10601): Terminated: ok {rc=0} 07:59:32.821776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10603): Launched 07:59:33.120715 run osmo-hlr_10.42.42.2(pid=10604): Launched 07:59:33.234204 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:33.761498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10606): Launched 07:59:34.059390 run osmo-stp_10.42.42.5(pid=10607): Launched 07:59:34.173728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:34.688785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10609): Launched 07:59:34.803288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:35.055397 run patchelf(pid=10610): Launched 07:59:35.221556 run osmo-stp_10.42.42.5(pid=10607): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10607)] 07:59:35.347100 run osmo-stp_10.42.42.5(pid=10607): stdout: | (launched: 2022-12-09_07:59:34.004158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:35.475533 run osmo-stp_10.42.42.5(pid=10607): stderr: | 20221209075934172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075934172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075934173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075934173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075934174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075934174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075934174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:35.604118 run osmo-stp_10.42.42.5(pid=10607): stdout: | (launched: 2022-12-09_07:59:34.004158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:35.727151 run osmo-stp_10.42.42.5(pid=10607): stderr: | 20221209075934172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075934172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075934173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075934173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075934174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075934174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075934174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:35.872837 run patchelf(pid=10610): Terminating (SIGINT) 07:59:36.039445 run patchelf(pid=10610): Terminated: ok {rc=0} 07:59:36.159614 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10607): Process ended prematurely: osmo-stp_10.42.42.5(pid=10607) [trial-2356↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10607)] [trial-2356↪gprs:nanobts+band-1900↪ping.py:22] 07:59:36.168609 tst ping.py:22: Test FAILED (6.5 sec) 07:59:36.196024 run osmo-hlr_10.42.42.2(pid=10604): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10604)] 07:59:36.244053 run osmo-hlr_10.42.42.2(pid=10604): stdout: | (launched: 2022-12-09_07:59:33.065183) 07:59:36.293525 run osmo-hlr_10.42.42.2(pid=10604): stderr: | 20221209075933240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075933240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075933240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075933240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075933240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075933240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075933253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075933262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075933262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075933262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:36.343526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10603): Terminating (SIGTERM) 07:59:36.383507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10606): Terminating (SIGTERM) 07:59:36.423399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10609): Terminating (SIGTERM) 07:59:36.463621 --- ParallelTerminationStrategy: PID 10603 died... 07:59:36.482709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10603): Terminated: ok {rc=0} 07:59:36.527354 --- ParallelTerminationStrategy: PID 10606 died... 07:59:36.546170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10606): Terminated: ok {rc=0} 07:59:36.590325 --- ParallelTerminationStrategy: PID 10609 died... 07:59:36.609040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10609): Terminated: ok {rc=0} 07:59:36.695005 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 07:59:37.781628 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:37.793455 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:59:37.834892 tst ping_idle_ping.py: using LAC 20050 07:59:37.953952 tst ping_idle_ping.py: using RAC 160 07:59:38.074648 tst ping_idle_ping.py: using CellId 20050 07:59:38.191637 tst ping_idle_ping.py: using BVCI 20051 07:59:38.300324 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.311204 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.322017 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.333178 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.344206 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.355241 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.366453 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:59:38.377599 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:59:38.499302 tst ping_idle_ping.py:24: start network... 07:59:38.700187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:39.169346 run create_hlr_db(pid=10611): Launched 07:59:39.282941 bus /gobi_6: Setting Powered False 07:59:40.342972 run create_hlr_db(pid=10611): Terminated: ok {rc=0} 07:59:40.782249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10613): Launched 07:59:41.105433 run osmo-hlr_10.42.42.2(pid=10614): Launched 07:59:41.228024 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:41.780385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10616): Launched 07:59:42.102322 run osmo-stp_10.42.42.5(pid=10617): Launched 07:59:42.226730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:42.783776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10619): Launched 07:59:42.906370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:43.178228 run patchelf(pid=10620): Launched 07:59:43.356752 run osmo-stp_10.42.42.5(pid=10617): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10617)] 07:59:43.492674 run osmo-stp_10.42.42.5(pid=10617): stdout: | (launched: 2022-12-09_07:59:42.042793) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:43.631018 run osmo-stp_10.42.42.5(pid=10617): stderr: | 20221209075942233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075942233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075942233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075942234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075942234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075942234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075942234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:43.768379 run osmo-stp_10.42.42.5(pid=10617): stdout: | (launched: 2022-12-09_07:59:42.042793) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:43.900220 run osmo-stp_10.42.42.5(pid=10617): stderr: | 20221209075942233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075942233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075942233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075942234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075942234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075942234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075942234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:44.056391 run patchelf(pid=10620): Terminating (SIGINT) 07:59:44.235302 run patchelf(pid=10620): Terminated: ok {rc=0} 07:59:44.364188 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10617): Process ended prematurely: osmo-stp_10.42.42.5(pid=10617) [trial-2356↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10617)] [trial-2356↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 07:59:44.373817 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:59:44.401721 run osmo-hlr_10.42.42.2(pid=10614): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10614)] 07:59:44.451682 run osmo-hlr_10.42.42.2(pid=10614): stdout: | (launched: 2022-12-09_07:59:41.045858) 07:59:44.502935 run osmo-hlr_10.42.42.2(pid=10614): stderr: | 20221209075941242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075941242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075941242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075941242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075941242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075941242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075941255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075941263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075941264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075941264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:44.554953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10613): Terminating (SIGTERM) 07:59:44.596814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10616): Terminating (SIGTERM) 07:59:44.638177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10619): Terminating (SIGTERM) 07:59:44.680236 --- ParallelTerminationStrategy: PID 10613 died... 07:59:44.700154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10613): Terminated: ok {rc=0} 07:59:44.745920 --- ParallelTerminationStrategy: PID 10616 died... 07:59:44.765416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10616): Terminated: ok {rc=0} 07:59:44.811035 --- ParallelTerminationStrategy: PID 10619 died... 07:59:44.830669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10619): Terminated: ok {rc=0} 07:59:44.917764 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 07:59:46.282235 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:59:46.293052 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:59:46.328097 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:59:46.383680 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:59:46.491597 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:59:46.516260 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:59:46.559058 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:59:47.155238 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:59:47.212330 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.224849 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:59:47.268831 tst cs_paging_gprs_active.py: using LAC 20051 07:59:47.401642 tst cs_paging_gprs_active.py: using RAC 161 07:59:47.531281 tst cs_paging_gprs_active.py: using CellId 20051 07:59:47.659877 tst cs_paging_gprs_active.py: using BVCI 20052 07:59:47.777865 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.789617 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.801197 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.812513 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.823787 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.834996 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.846508 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.857839 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:59:47.869299 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:59:47.986366 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:59:48.106744 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:59:48.328362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:48.657150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10624): Launched 07:59:48.941091 run iperf3-srv_10.42.42.10(pid=10625): Launched 07:59:49.064284 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:59:49.285463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:49.614400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10626): Launched 07:59:49.900195 run iperf3-srv_10.42.42.10(pid=10627): Launched 07:59:50.023361 tst cs_paging_gprs_active.py:38: start network... 07:59:50.244175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:50.752526 run create_hlr_db(pid=10628): Launched 07:59:50.884902 bus /gobi_6: Setting Powered False 07:59:51.949122 run create_hlr_db(pid=10628): Terminated: ok {rc=0} 07:59:52.384487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10630): Launched 07:59:52.691652 run osmo-hlr_10.42.42.2(pid=10631): Launched 07:59:52.807792 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:53.374353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10633): Launched 07:59:53.702177 run osmo-stp_10.42.42.5(pid=10634): Launched 07:59:53.825641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:54.386832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10636): Launched 07:59:54.511808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:54.787584 run patchelf(pid=10637): Launched 07:59:54.970694 run osmo-stp_10.42.42.5(pid=10634): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10634)] 07:59:55.108184 run osmo-stp_10.42.42.5(pid=10634): stdout: | (launched: 2022-12-09_07:59:53.641881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:55.247306 run osmo-stp_10.42.42.5(pid=10634): stderr: | 20221209075953833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075953833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075953834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075953834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075953834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075953834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075953834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:55.386628 run osmo-stp_10.42.42.5(pid=10634): stdout: | (launched: 2022-12-09_07:59:53.641881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:55.520541 run osmo-stp_10.42.42.5(pid=10634): stderr: | 20221209075953833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209075953833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209075953834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209075953834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209075953834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209075953834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209075953834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:55.679387 run patchelf(pid=10637): Terminating (SIGINT) 07:59:55.860494 run patchelf(pid=10637): Terminated: ok {rc=0} 07:59:55.991220 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10634): Process ended prematurely: osmo-stp_10.42.42.5(pid=10634) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10634)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:59:56.001644 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:59:56.030235 run osmo-hlr_10.42.42.2(pid=10631): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10631)] 07:59:56.080023 run osmo-hlr_10.42.42.2(pid=10631): stdout: | (launched: 2022-12-09_07:59:52.635137) 07:59:56.131732 run osmo-hlr_10.42.42.2(pid=10631): stderr: | 20221209075952808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209075952808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209075952808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209075952808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209075952808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209075952808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209075952821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209075952829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209075952830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209075952830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:56.183739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10624): Terminating (SIGTERM) 07:59:56.225711 run iperf3-srv_10.42.42.10(pid=10625): Terminating (SIGTERM) 07:59:56.267389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10626): Terminating (SIGTERM) 07:59:56.309219 run iperf3-srv_10.42.42.10(pid=10627): Terminating (SIGTERM) 07:59:56.350988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10630): Terminating (SIGTERM) 07:59:56.392710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10633): Terminating (SIGTERM) 07:59:56.434371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10636): Terminating (SIGTERM) 07:59:56.476317 --- ParallelTerminationStrategy: PID 10624 died... 07:59:56.496278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10624): Terminated: ok {rc=0} 07:59:56.542883 --- ParallelTerminationStrategy: PID 10625 died... 07:59:56.562314 run iperf3-srv_10.42.42.10(pid=10625): Terminated {rc=256} 07:59:56.608211 --- ParallelTerminationStrategy: PID 10626 died... 07:59:56.627738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10626): Terminated: ok {rc=0} 07:59:56.673600 --- ParallelTerminationStrategy: PID 10627 died... 07:59:56.693032 run iperf3-srv_10.42.42.10(pid=10627): Terminated {rc=256} 07:59:56.739136 --- ParallelTerminationStrategy: PID 10630 died... 07:59:56.758737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10630): Terminated: ok {rc=0} 07:59:56.804386 --- ParallelTerminationStrategy: PID 10633 died... 07:59:56.823895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10633): Terminated: ok {rc=0} 07:59:56.869534 --- ParallelTerminationStrategy: PID 10636 died... 07:59:56.889088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10636): Terminated: ok {rc=0} 07:59:56.976599 bus /gobi_0: Setting Powered False 07:59:58.074852 bus /gobi_0: Setting Powered False 07:59:59.189625 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:00:00.338187 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.350565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:00:00.395106 tst iperf3.py: using LAC 20052 08:00:00.524087 tst iperf3.py: using RAC 162 08:00:00.652880 tst iperf3.py: using CellId 20052 08:00:00.780125 tst iperf3.py: using BVCI 20053 08:00:00.910584 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.922884 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.934990 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.946884 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.958793 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.970794 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.983070 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:00.994987 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:01.007465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:01.143809 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:00:01.359051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:01.697282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10644): Launched 08:00:02.006504 run iperf3-srv_10.42.42.10(pid=10645): Launched 08:00:02.174755 tst iperf3.py:8: start network... 08:00:02.392759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:02.869459 run create_hlr_db(pid=10646): Launched 08:00:02.986447 bus /gobi_6: Setting Powered False 08:00:04.046012 run create_hlr_db(pid=10646): Terminated: ok {rc=0} 08:00:04.469290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10648): Launched 08:00:04.773664 run osmo-hlr_10.42.42.2(pid=10649): Launched 08:00:04.889197 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:05.425144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10651): Launched 08:00:05.731346 run osmo-stp_10.42.42.5(pid=10652): Launched 08:00:05.847697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:00:06.372494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10654): Launched 08:00:06.488923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:00:06.746743 run patchelf(pid=10655): Launched 08:00:06.915950 run osmo-stp_10.42.42.5(pid=10652): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10652)] 08:00:07.045152 run osmo-stp_10.42.42.5(pid=10652): stdout: | (launched: 2022-12-09_08:00:05.674489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:07.175519 run osmo-stp_10.42.42.5(pid=10652): stderr: | 20221209080005841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080005842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080005842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080005842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080005843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080005843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080005843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:07.305979 run osmo-stp_10.42.42.5(pid=10652): stdout: | (launched: 2022-12-09_08:00:05.674489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:07.430690 run osmo-stp_10.42.42.5(pid=10652): stderr: | 20221209080005841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080005842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080005842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080005842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080005843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080005843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080005843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:07.578970 run patchelf(pid=10655): Terminating (SIGINT) 08:00:07.749531 run patchelf(pid=10655): Terminated: ok {rc=0} 08:00:07.872130 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10652): Process ended prematurely: osmo-stp_10.42.42.5(pid=10652) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10652)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 08:00:07.881740 tst iperf3.py:8: Test FAILED (7.6 sec) 08:00:07.909280 run osmo-hlr_10.42.42.2(pid=10649): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10649)] 08:00:07.957175 run osmo-hlr_10.42.42.2(pid=10649): stdout: | (launched: 2022-12-09_08:00:04.717438) 08:00:08.006588 run osmo-hlr_10.42.42.2(pid=10649): stderr: | 20221209080004889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080004889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080004889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080004889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080004889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080004889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080004901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080004910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080004910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080004910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:08.056526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10644): Terminating (SIGTERM) 08:00:08.096181 run iperf3-srv_10.42.42.10(pid=10645): Terminating (SIGTERM) 08:00:08.136072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10648): Terminating (SIGTERM) 08:00:08.175918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10651): Terminating (SIGTERM) 08:00:08.215597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10654): Terminating (SIGTERM) 08:00:08.255689 --- ParallelTerminationStrategy: PID 10644 died... 08:00:08.274670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10644): Terminated: ok {rc=0} 08:00:08.318692 --- ParallelTerminationStrategy: PID 10645 died... 08:00:08.336938 run iperf3-srv_10.42.42.10(pid=10645): Terminated {rc=256} 08:00:08.380545 --- ParallelTerminationStrategy: PID 10648 died... 08:00:08.398983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10648): Terminated: ok {rc=0} 08:00:08.442519 --- ParallelTerminationStrategy: PID 10651 died... 08:00:08.460832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10651): Terminated: ok {rc=0} 08:00:08.505181 --- ParallelTerminationStrategy: PID 10654 died... 08:00:08.523532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10654): Terminated: ok {rc=0} 08:00:08.608536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:00:09.754462 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:09.766284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:00:09.808719 tst iperf3m4.py: using LAC 20053 08:00:09.929660 tst iperf3m4.py: using RAC 163 08:00:10.047737 tst iperf3m4.py: using CellId 20053 08:00:10.167638 tst iperf3m4.py: using BVCI 20054 08:00:10.278444 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.289551 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.300370 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.311462 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.322617 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.333765 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.344863 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.355889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:10.367370 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:10.488072 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:10.613134 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:10.731074 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:10.847810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:00:11.051991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:11.357371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10656): Launched 08:00:11.623593 run iperf3-srv_10.42.42.10(pid=10657): Launched 08:00:11.738189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:00:11.942994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:12.249369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10658): Launched 08:00:12.513833 run iperf3-srv_10.42.42.10(pid=10659): Launched 08:00:12.627949 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:00:12.831143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:13.136350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10660): Launched 08:00:13.401291 run iperf3-srv_10.42.42.10(pid=10661): Launched 08:00:13.515061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:00:13.718927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:14.025334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10662): Launched 08:00:14.288898 run iperf3-srv_10.42.42.10(pid=10663): Launched 08:00:14.402786 tst iperf3m4.py:8: start network... 08:00:14.607134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:15.078236 run create_hlr_db(pid=10664): Launched 08:00:15.195478 bus /gobi_6: Setting Powered False 08:00:16.255964 run create_hlr_db(pid=10664): Terminated: ok {rc=0} 08:00:16.700875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10666): Launched 08:00:17.017821 run osmo-hlr_10.42.42.2(pid=10667): Launched 08:00:17.216809 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:17.790955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10669): Launched 08:00:18.118082 run osmo-stp_10.42.42.5(pid=10670): Launched 08:00:18.246209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:00:18.810061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10672): Launched 08:00:18.934610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:00:19.211222 run patchelf(pid=10673): Launched 08:00:19.394027 run osmo-stp_10.42.42.5(pid=10670): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10670)] 08:00:19.531530 run osmo-stp_10.42.42.5(pid=10670): stdout: | (launched: 2022-12-09_08:00:18.057849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:19.671018 run osmo-stp_10.42.42.5(pid=10670): stderr: | 20221209080018247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080018247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080018247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080018248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080018248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080018248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080018249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:19.810537 run osmo-stp_10.42.42.5(pid=10670): stdout: | (launched: 2022-12-09_08:00:18.057849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:19.943890 run osmo-stp_10.42.42.5(pid=10670): stderr: | 20221209080018247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080018247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080018247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080018248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080018248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080018248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080018249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:20.101863 run patchelf(pid=10673): Terminating (SIGINT) 08:00:20.284170 run patchelf(pid=10673): Terminated: ok {rc=0} 08:00:20.415765 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10670): Process ended prematurely: osmo-stp_10.42.42.5(pid=10670) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10670)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 08:00:20.426114 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:00:20.454910 run osmo-hlr_10.42.42.2(pid=10667): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10667)] 08:00:20.504348 run osmo-hlr_10.42.42.2(pid=10667): stdout: | (launched: 2022-12-09_08:00:16.960638) 08:00:20.555760 run osmo-hlr_10.42.42.2(pid=10667): stderr: | 20221209080017301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080017301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080017301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080017301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080017301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080017301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080017313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080017322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080017322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080017322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:20.607234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10656): Terminating (SIGTERM) 08:00:20.648393 run iperf3-srv_10.42.42.10(pid=10657): Terminating (SIGTERM) 08:00:20.689808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10658): Terminating (SIGTERM) 08:00:20.731111 run iperf3-srv_10.42.42.10(pid=10659): Terminating (SIGTERM) 08:00:20.772250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10660): Terminating (SIGTERM) 08:00:20.813885 run iperf3-srv_10.42.42.10(pid=10661): Terminating (SIGTERM) 08:00:20.855299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10662): Terminating (SIGTERM) 08:00:20.896623 run iperf3-srv_10.42.42.10(pid=10663): Terminating (SIGTERM) 08:00:20.938011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10666): Terminating (SIGTERM) 08:00:20.979372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10669): Terminating (SIGTERM) 08:00:21.020722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10672): Terminating (SIGTERM) 08:00:21.062386 --- ParallelTerminationStrategy: PID 10656 died... 08:00:21.082417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10656): Terminated: ok {rc=0} 08:00:21.128416 --- ParallelTerminationStrategy: PID 10657 died... 08:00:21.147798 run iperf3-srv_10.42.42.10(pid=10657): Terminated {rc=256} 08:00:21.194059 --- ParallelTerminationStrategy: PID 10658 died... 08:00:21.213675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10658): Terminated: ok {rc=0} 08:00:21.259310 --- ParallelTerminationStrategy: PID 10659 died... 08:00:21.278856 run iperf3-srv_10.42.42.10(pid=10659): Terminated {rc=256} 08:00:21.324628 --- ParallelTerminationStrategy: PID 10660 died... 08:00:21.344289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10660): Terminated: ok {rc=0} 08:00:21.389947 --- ParallelTerminationStrategy: PID 10661 died... 08:00:21.409254 run iperf3-srv_10.42.42.10(pid=10661): Terminated {rc=256} 08:00:21.454944 --- ParallelTerminationStrategy: PID 10662 died... 08:00:21.474318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10662): Terminated: ok {rc=0} 08:00:21.520546 --- ParallelTerminationStrategy: PID 10663 died... 08:00:21.540285 run iperf3-srv_10.42.42.10(pid=10663): Terminated {rc=256} 08:00:21.585911 --- ParallelTerminationStrategy: PID 10666 died... 08:00:21.605295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10666): Terminated: ok {rc=0} 08:00:21.650873 --- ParallelTerminationStrategy: PID 10669 died... 08:00:21.670328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10669): Terminated: ok {rc=0} 08:00:21.716051 --- ParallelTerminationStrategy: PID 10672 died... 08:00:21.735658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10672): Terminated: ok {rc=0} 08:00:21.823499 bus /gobi_4: Setting Powered False 08:00:22.923255 bus /gobi_4: Setting Powered False 08:00:24.039029 bus /gobi_1: Setting Powered False 08:00:25.137286 bus /gobi_1: Setting Powered False 08:00:26.255608 bus /gobi_0: Setting Powered False 08:00:27.353880 bus /gobi_0: Setting Powered False 08:00:28.471508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 08:00:29.574249 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:29.586567 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:00:29.629731 tst ping.py: using LAC 20054 08:00:29.756729 tst ping.py: using RAC 164 08:00:29.882606 tst ping.py: using CellId 20054 08:00:30.010295 tst ping.py: using BVCI 20055 08:00:30.128239 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.139836 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.151254 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.162655 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.173994 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.185294 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.196722 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:30.208190 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:30.328813 tst ping.py:19: start network... 08:00:30.543566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:31.065363 run create_hlr_db(pid=10674): Launched 08:00:31.209709 bus /gobi_6: Setting Powered False 08:00:32.273177 run create_hlr_db(pid=10674): Terminated: ok {rc=0} 08:00:32.701936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10676): Launched 08:00:33.001623 run osmo-hlr_10.42.42.2(pid=10677): Launched 08:00:33.116037 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:33.639007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10679): Launched 08:00:33.940891 run osmo-stp_10.42.42.5(pid=10680): Launched 08:00:34.056045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:00:34.573934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10682): Launched 08:00:34.688289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:00:34.942487 run patchelf(pid=10683): Launched 08:00:35.111057 run osmo-stp_10.42.42.5(pid=10680): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10680)] 08:00:35.237604 run osmo-stp_10.42.42.5(pid=10680): stdout: | (launched: 2022-12-09_08:00:33.884802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:35.365779 run osmo-stp_10.42.42.5(pid=10680): stderr: | 20221209080034053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080034053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080034053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080034054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080034054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080034054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080034054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:35.493324 run osmo-stp_10.42.42.5(pid=10680): stdout: | (launched: 2022-12-09_08:00:33.884802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:35.615598 run osmo-stp_10.42.42.5(pid=10680): stderr: | 20221209080034053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080034053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080034053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080034054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080034054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080034054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080034054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:35.760076 run patchelf(pid=10683): Terminating (SIGINT) 08:00:35.927612 run patchelf(pid=10683): Terminated: ok {rc=0} 08:00:36.048097 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10680): Process ended prematurely: osmo-stp_10.42.42.5(pid=10680) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10680)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 08:00:36.057128 tst ping.py:22: Test FAILED (6.5 sec) 08:00:36.084011 run osmo-hlr_10.42.42.2(pid=10677): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10677)] 08:00:36.132175 run osmo-hlr_10.42.42.2(pid=10677): stdout: | (launched: 2022-12-09_08:00:32.945828) 08:00:36.181629 run osmo-hlr_10.42.42.2(pid=10677): stderr: | 20221209080033119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080033119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080033119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080033120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080033120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080033120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080033132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080033141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080033141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080033141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:36.231480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10676): Terminating (SIGTERM) 08:00:36.271138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10679): Terminating (SIGTERM) 08:00:36.311073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10682): Terminating (SIGTERM) 08:00:36.351537 --- ParallelTerminationStrategy: PID 10676 died... 08:00:36.370645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10676): Terminated: ok {rc=0} 08:00:36.415747 --- ParallelTerminationStrategy: PID 10679 died... 08:00:36.434499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10679): Terminated: ok {rc=0} 08:00:36.479097 --- ParallelTerminationStrategy: PID 10682 died... 08:00:36.497895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10682): Terminated: ok {rc=0} 08:00:36.584674 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:00:37.674116 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:37.686476 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:00:37.733831 tst ping_idle_ping.py: using LAC 20055 08:00:37.851881 tst ping_idle_ping.py: using RAC 165 08:00:37.968132 tst ping_idle_ping.py: using CellId 20055 08:00:38.084171 tst ping_idle_ping.py: using BVCI 20056 08:00:38.193197 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.204293 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.215246 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.226545 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.237725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.248710 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.260010 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:00:38.271104 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:00:38.385877 tst ping_idle_ping.py:24: start network... 08:00:38.587005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:39.060602 run create_hlr_db(pid=10684): Launched 08:00:39.175101 bus /gobi_6: Setting Powered False 08:00:40.236172 run create_hlr_db(pid=10684): Terminated: ok {rc=0} 08:00:40.677947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10686): Launched 08:00:41.002111 run osmo-hlr_10.42.42.2(pid=10687): Launched 08:00:41.126857 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:41.688236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10689): Launched 08:00:42.010861 run osmo-stp_10.42.42.5(pid=10690): Launched 08:00:42.134509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:00:42.689498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10692): Launched 08:00:42.812330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:00:43.083048 run patchelf(pid=10693): Launched 08:00:43.261282 run osmo-stp_10.42.42.5(pid=10690): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10690)] 08:00:43.396370 run osmo-stp_10.42.42.5(pid=10690): stdout: | (launched: 2022-12-09_08:00:41.951312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:43.533127 run osmo-stp_10.42.42.5(pid=10690): stderr: | 20221209080042141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080042141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080042142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080042142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080042143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080042143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080042143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:43.670059 run osmo-stp_10.42.42.5(pid=10690): stdout: | (launched: 2022-12-09_08:00:41.951312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:43.801256 run osmo-stp_10.42.42.5(pid=10690): stderr: | 20221209080042141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080042141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080042142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080042142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080042143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080042143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080042143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:43.957055 run patchelf(pid=10693): Terminating (SIGINT) 08:00:44.135874 run patchelf(pid=10693): Terminated: ok {rc=0} 08:00:44.264642 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10690): Process ended prematurely: osmo-stp_10.42.42.5(pid=10690) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10690)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 08:00:44.274371 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:00:44.302322 run osmo-hlr_10.42.42.2(pid=10687): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10687)] 08:00:44.352126 run osmo-hlr_10.42.42.2(pid=10687): stdout: | (launched: 2022-12-09_08:00:40.943084) 08:00:44.403512 run osmo-hlr_10.42.42.2(pid=10687): stderr: | 20221209080041136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080041136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080041136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080041136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080041136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080041136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080041148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080041157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080041157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080041158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:44.455249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10686): Terminating (SIGTERM) 08:00:44.496391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10689): Terminating (SIGTERM) 08:00:44.537861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10692): Terminating (SIGTERM) 08:00:44.579493 --- ParallelTerminationStrategy: PID 10686 died... 08:00:44.599546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10686): Terminated: ok {rc=0} 08:00:44.645394 --- ParallelTerminationStrategy: PID 10689 died... 08:00:44.664749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10689): Terminated: ok {rc=0} 08:00:44.710551 --- ParallelTerminationStrategy: PID 10692 died... 08:00:44.729818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10692): Terminated: ok {rc=0} 08:00:44.815691 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:00:46.131568 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:46.139017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:00:46.166658 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:00:46.209693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:00:46.301841 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:00:46.333570 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:00:46.385083 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:00:46.995805 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:00:47.053208 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.065837 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:00:47.128939 tst cs_paging_gprs_active.py: using LAC 20056 08:00:47.254475 tst cs_paging_gprs_active.py: using RAC 166 08:00:47.379262 tst cs_paging_gprs_active.py: using CellId 20056 08:00:47.498555 tst cs_paging_gprs_active.py: using BVCI 20057 08:00:47.609459 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.620646 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.631764 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.643247 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.654640 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.666080 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.677660 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.688866 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:00:47.700109 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:00:47.823336 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:00:47.947008 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:00:48.168901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:48.496689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10697): Launched 08:00:48.781171 run iperf3-srv_10.42.42.10(pid=10698): Launched 08:00:48.903548 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:00:49.124810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:00:49.452851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10699): Launched 08:00:49.736498 run iperf3-srv_10.42.42.10(pid=10700): Launched 08:00:49.859234 tst cs_paging_gprs_active.py:38: start network... 08:00:50.080485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:50.588786 run create_hlr_db(pid=10701): Launched 08:00:50.722020 bus /gobi_6: Setting Powered False 08:00:51.786582 run create_hlr_db(pid=10701): Terminated: ok {rc=0} 08:00:52.240827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10703): Launched 08:00:52.567556 run osmo-hlr_10.42.42.2(pid=10704): Launched 08:00:52.691105 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:53.251192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10706): Launched 08:00:53.577860 run osmo-stp_10.42.42.5(pid=10707): Launched 08:00:53.702442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:00:54.266491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10709): Launched 08:00:54.391213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:00:54.667698 run patchelf(pid=10710): Launched 08:00:54.848834 run osmo-stp_10.42.42.5(pid=10707): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10707)] 08:00:54.986681 run osmo-stp_10.42.42.5(pid=10707): stdout: | (launched: 2022-12-09_08:00:53.517175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:55.126031 run osmo-stp_10.42.42.5(pid=10707): stderr: | 20221209080053708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080053708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080053708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080053709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080053709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080053709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080053709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:55.265621 run osmo-stp_10.42.42.5(pid=10707): stdout: | (launched: 2022-12-09_08:00:53.517175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:55.399405 run osmo-stp_10.42.42.5(pid=10707): stderr: | 20221209080053708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080053708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080053708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080053709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080053709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080053709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080053709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:55.558695 run patchelf(pid=10710): Terminating (SIGINT) 08:00:55.740211 run patchelf(pid=10710): Terminated: ok {rc=0} 08:00:55.871380 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10707): Process ended prematurely: osmo-stp_10.42.42.5(pid=10707) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10707)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:00:55.881745 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 08:00:55.910416 run osmo-hlr_10.42.42.2(pid=10704): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10704)] 08:00:55.960629 run osmo-hlr_10.42.42.2(pid=10704): stdout: | (launched: 2022-12-09_08:00:52.506888) 08:00:56.012355 run osmo-hlr_10.42.42.2(pid=10704): stderr: | 20221209080052704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080052704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080052704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080052704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080052704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080052704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080052717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080052725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080052725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080052725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:56.064579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10697): Terminating (SIGTERM) 08:00:56.106781 run iperf3-srv_10.42.42.10(pid=10698): Terminating (SIGTERM) 08:00:56.148353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10699): Terminating (SIGTERM) 08:00:56.189810 run iperf3-srv_10.42.42.10(pid=10700): Terminating (SIGTERM) 08:00:56.230996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10703): Terminating (SIGTERM) 08:00:56.272300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10706): Terminating (SIGTERM) 08:00:56.313618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10709): Terminating (SIGTERM) 08:00:56.355128 --- ParallelTerminationStrategy: PID 10697 died... 08:00:56.375176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10697): Terminated: ok {rc=0} 08:00:56.421095 --- ParallelTerminationStrategy: PID 10698 died... 08:00:56.440343 run iperf3-srv_10.42.42.10(pid=10698): Terminated {rc=256} 08:00:56.486007 --- ParallelTerminationStrategy: PID 10699 died... 08:00:56.505400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10699): Terminated: ok {rc=0} 08:00:56.551352 --- ParallelTerminationStrategy: PID 10700 died... 08:00:56.570725 run iperf3-srv_10.42.42.10(pid=10700): Terminated {rc=256} 08:00:56.616111 --- ParallelTerminationStrategy: PID 10703 died... 08:00:56.635397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10703): Terminated: ok {rc=0} 08:00:56.680713 --- ParallelTerminationStrategy: PID 10706 died... 08:00:56.700096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10706): Terminated: ok {rc=0} 08:00:56.745922 --- ParallelTerminationStrategy: PID 10709 died... 08:00:56.765275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10709): Terminated: ok {rc=0} 08:00:56.851146 bus /gobi_0: Setting Powered False 08:00:57.949962 bus /gobi_0: Setting Powered False 08:00:59.064066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:01:00.213012 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.225373 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:01:00.289727 tst iperf3.py: using LAC 20057 08:01:00.417482 tst iperf3.py: using RAC 167 08:01:00.544324 tst iperf3.py: using CellId 20057 08:01:00.672015 tst iperf3.py: using BVCI 20058 08:01:00.790442 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.802194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.813684 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.825104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.844417 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.866009 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.881294 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.907789 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:00.920205 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:01.046817 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:01:01.334909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:01.700032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10711): Launched 08:01:01.998093 run iperf3-srv_10.42.42.10(pid=10712): Launched 08:01:02.134923 tst iperf3.py:8: start network... 08:01:02.358046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:02.865658 run create_hlr_db(pid=10713): Launched 08:01:02.999607 bus /gobi_6: Setting Powered False 08:01:04.064727 run create_hlr_db(pid=10713): Terminated: ok {rc=0} 08:01:04.519198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10715): Launched 08:01:04.847314 run osmo-hlr_10.42.42.2(pid=10716): Launched 08:01:04.972806 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:05.534587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10718): Launched 08:01:05.860391 run osmo-stp_10.42.42.5(pid=10719): Launched 08:01:05.983394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:06.543901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10721): Launched 08:01:06.668002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:06.943252 run patchelf(pid=10722): Launched 08:01:07.125206 run osmo-stp_10.42.42.5(pid=10719): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10719)] 08:01:07.262728 run osmo-stp_10.42.42.5(pid=10719): stdout: | (launched: 2022-12-09_08:01:05.800918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:07.401701 run osmo-stp_10.42.42.5(pid=10719): stderr: | 20221209080105991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080105991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080105991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080105991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080105992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080105992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080105992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:07.540768 run osmo-stp_10.42.42.5(pid=10719): stdout: | (launched: 2022-12-09_08:01:05.800918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:07.674520 run osmo-stp_10.42.42.5(pid=10719): stderr: | 20221209080105991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080105991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080105991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080105991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080105992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080105992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080105992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:07.832263 run patchelf(pid=10722): Terminating (SIGINT) 08:01:08.013906 run patchelf(pid=10722): Terminated: ok {rc=0} 08:01:08.144362 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10719): Process ended prematurely: osmo-stp_10.42.42.5(pid=10719) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10719)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 08:01:08.154661 tst iperf3.py:8: Test FAILED (8.0 sec) 08:01:08.183144 run osmo-hlr_10.42.42.2(pid=10716): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10716)] 08:01:08.233087 run osmo-hlr_10.42.42.2(pid=10716): stdout: | (launched: 2022-12-09_08:01:04.787630) 08:01:08.284217 run osmo-hlr_10.42.42.2(pid=10716): stderr: | 20221209080104984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080104984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080104984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080104984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080104984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080104984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080104997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080105005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080105006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080105006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:08.335899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10711): Terminating (SIGTERM) 08:01:08.377211 run iperf3-srv_10.42.42.10(pid=10712): Terminating (SIGTERM) 08:01:08.418543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10715): Terminating (SIGTERM) 08:01:08.460167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10718): Terminating (SIGTERM) 08:01:08.501646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10721): Terminating (SIGTERM) 08:01:08.543328 --- ParallelTerminationStrategy: PID 10711 died... 08:01:08.563220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10711): Terminated: ok {rc=0} 08:01:08.609174 --- ParallelTerminationStrategy: PID 10712 died... 08:01:08.628541 run iperf3-srv_10.42.42.10(pid=10712): Terminated {rc=256} 08:01:08.673958 --- ParallelTerminationStrategy: PID 10715 died... 08:01:08.693379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10715): Terminated: ok {rc=0} 08:01:08.738583 --- ParallelTerminationStrategy: PID 10718 died... 08:01:08.757984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10718): Terminated: ok {rc=0} 08:01:08.803660 --- ParallelTerminationStrategy: PID 10721 died... 08:01:08.823148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10721): Terminated: ok {rc=0} 08:01:08.911080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:01:10.062230 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.074675 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:01:10.134949 tst iperf3m4.py: using LAC 20058 08:01:10.262628 tst iperf3m4.py: using RAC 168 08:01:10.390793 tst iperf3m4.py: using CellId 20058 08:01:10.516870 tst iperf3m4.py: using BVCI 20059 08:01:10.635617 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.647302 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.658695 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.670149 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.681529 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.692782 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.704311 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.716148 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:10.727921 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:10.849654 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:10.973075 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:11.092286 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:11.212501 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:01:11.418042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:11.724832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10723): Launched 08:01:11.990341 run iperf3-srv_10.42.42.10(pid=10724): Launched 08:01:12.107003 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:01:12.312281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:12.619802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10725): Launched 08:01:12.886339 run iperf3-srv_10.42.42.10(pid=10726): Launched 08:01:13.000504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:01:13.205444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:13.512439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10727): Launched 08:01:13.778849 run iperf3-srv_10.42.42.10(pid=10728): Launched 08:01:13.893609 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:01:14.098844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:14.406557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10729): Launched 08:01:14.674213 run iperf3-srv_10.42.42.10(pid=10730): Launched 08:01:14.790308 tst iperf3m4.py:8: start network... 08:01:14.994602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:15.466554 run create_hlr_db(pid=10731): Launched 08:01:15.584882 bus /gobi_6: Setting Powered False 08:01:16.644047 run create_hlr_db(pid=10731): Terminated: ok {rc=0} 08:01:17.076491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10733): Launched 08:01:17.388246 run osmo-hlr_10.42.42.2(pid=10734): Launched 08:01:17.506662 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:18.043799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10736): Launched 08:01:18.351090 run osmo-stp_10.42.42.5(pid=10737): Launched 08:01:18.467849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:18.991810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10739): Launched 08:01:19.108582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:19.367036 run patchelf(pid=10740): Launched 08:01:19.537672 run osmo-stp_10.42.42.5(pid=10737): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10737)] 08:01:19.666131 run osmo-stp_10.42.42.5(pid=10737): stdout: | (launched: 2022-12-09_08:01:18.294334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:19.796395 run osmo-stp_10.42.42.5(pid=10737): stderr: | 20221209080118462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080118462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080118462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080118462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080118463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080118463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080118463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:19.926995 run osmo-stp_10.42.42.5(pid=10737): stdout: | (launched: 2022-12-09_08:01:18.294334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:20.051529 run osmo-stp_10.42.42.5(pid=10737): stderr: | 20221209080118462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080118462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080118462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080118462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080118463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080118463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080118463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:20.199236 run patchelf(pid=10740): Terminating (SIGINT) 08:01:20.369717 run patchelf(pid=10740): Terminated: ok {rc=0} 08:01:20.492297 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10737): Process ended prematurely: osmo-stp_10.42.42.5(pid=10737) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10737)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:01:20.502060 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:01:20.530300 run osmo-hlr_10.42.42.2(pid=10734): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10734)] 08:01:20.578110 run osmo-hlr_10.42.42.2(pid=10734): stdout: | (launched: 2022-12-09_08:01:17.331626) 08:01:20.627373 run osmo-hlr_10.42.42.2(pid=10734): stderr: | 20221209080117506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080117506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080117506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080117506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080117506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080117506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080117518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080117529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080117529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080117529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:20.677357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10723): Terminating (SIGTERM) 08:01:20.717195 run iperf3-srv_10.42.42.10(pid=10724): Terminating (SIGTERM) 08:01:20.756694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10725): Terminating (SIGTERM) 08:01:20.796434 run iperf3-srv_10.42.42.10(pid=10726): Terminating (SIGTERM) 08:01:20.836003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10727): Terminating (SIGTERM) 08:01:20.875516 run iperf3-srv_10.42.42.10(pid=10728): Terminating (SIGTERM) 08:01:20.914977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10729): Terminating (SIGTERM) 08:01:20.954607 run iperf3-srv_10.42.42.10(pid=10730): Terminating (SIGTERM) 08:01:20.994039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10733): Terminating (SIGTERM) 08:01:21.033616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10736): Terminating (SIGTERM) 08:01:21.073361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10739): Terminating (SIGTERM) 08:01:21.113651 --- ParallelTerminationStrategy: PID 10723 died... 08:01:21.132770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10723): Terminated: ok {rc=0} 08:01:21.177262 --- ParallelTerminationStrategy: PID 10724 died... 08:01:21.195826 run iperf3-srv_10.42.42.10(pid=10724): Terminated {rc=256} 08:01:21.239479 --- ParallelTerminationStrategy: PID 10725 died... 08:01:21.258317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10725): Terminated: ok {rc=0} 08:01:21.302370 --- ParallelTerminationStrategy: PID 10726 died... 08:01:21.320981 run iperf3-srv_10.42.42.10(pid=10726): Terminated {rc=256} 08:01:21.365216 --- ParallelTerminationStrategy: PID 10727 died... 08:01:21.383893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10727): Terminated: ok {rc=0} 08:01:21.428073 --- ParallelTerminationStrategy: PID 10728 died... 08:01:21.446520 run iperf3-srv_10.42.42.10(pid=10728): Terminated {rc=256} 08:01:21.490725 --- ParallelTerminationStrategy: PID 10729 died... 08:01:21.509250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10729): Terminated: ok {rc=0} 08:01:21.553322 --- ParallelTerminationStrategy: PID 10730 died... 08:01:21.571863 run iperf3-srv_10.42.42.10(pid=10730): Terminated {rc=256} 08:01:21.615610 --- ParallelTerminationStrategy: PID 10733 died... 08:01:21.634070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10733): Terminated: ok {rc=0} 08:01:21.677646 --- ParallelTerminationStrategy: PID 10736 died... 08:01:21.695954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10736): Terminated: ok {rc=0} 08:01:21.739744 --- ParallelTerminationStrategy: PID 10739 died... 08:01:21.758610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10739): Terminated: ok {rc=0} 08:01:21.843071 bus /gobi_4: Setting Powered False 08:01:22.942576 bus /gobi_4: Setting Powered False 08:01:24.058584 bus /gobi_1: Setting Powered False 08:01:25.156308 bus /gobi_1: Setting Powered False 08:01:26.268709 bus /gobi_0: Setting Powered False 08:01:27.365997 bus /gobi_0: Setting Powered False 08:01:28.481822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:01:29.583810 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:29.596038 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:01:29.659410 tst ping.py: using LAC 20059 08:01:29.787392 tst ping.py: using RAC 169 08:01:29.914896 tst ping.py: using CellId 20059 08:01:30.042934 tst ping.py: using BVCI 20060 08:01:30.160776 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.172473 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.183932 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.195268 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.206612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.218050 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.229644 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:30.241032 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:30.360891 tst ping.py:19: start network... 08:01:30.578155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:31.088325 run create_hlr_db(pid=10742): Launched 08:01:31.244926 bus /gobi_6: Setting Powered False 08:01:32.307636 run create_hlr_db(pid=10742): Terminated: ok {rc=0} 08:01:32.736608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10744): Launched 08:01:33.037237 run osmo-hlr_10.42.42.2(pid=10745): Launched 08:01:33.151753 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:33.686347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10747): Launched 08:01:33.986681 run osmo-stp_10.42.42.5(pid=10748): Launched 08:01:34.101742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:34.619274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10750): Launched 08:01:34.733222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:34.985058 run patchelf(pid=10751): Launched 08:01:35.151102 run osmo-stp_10.42.42.5(pid=10748): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10748)] 08:01:35.277614 run osmo-stp_10.42.42.5(pid=10748): stdout: | (launched: 2022-12-09_08:01:33.931115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:35.405271 run osmo-stp_10.42.42.5(pid=10748): stderr: | 20221209080134099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080134099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080134099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080134100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080134100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080134100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080134100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:35.533220 run osmo-stp_10.42.42.5(pid=10748): stdout: | (launched: 2022-12-09_08:01:33.931115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:35.655827 run osmo-stp_10.42.42.5(pid=10748): stderr: | 20221209080134099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080134099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080134099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080134100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080134100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080134100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080134100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:35.800709 run patchelf(pid=10751): Terminating (SIGINT) 08:01:35.967259 run patchelf(pid=10751): Terminated: ok {rc=0} 08:01:36.087026 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10748): Process ended prematurely: osmo-stp_10.42.42.5(pid=10748) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10748)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 08:01:36.095986 tst ping.py:22: Test FAILED (6.5 sec) 08:01:36.122922 run osmo-hlr_10.42.42.2(pid=10745): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10745)] 08:01:36.170418 run osmo-hlr_10.42.42.2(pid=10745): stdout: | (launched: 2022-12-09_08:01:32.981569) 08:01:36.219559 run osmo-hlr_10.42.42.2(pid=10745): stderr: | 20221209080133152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080133152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080133152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080133152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080133152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080133152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080133164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080133174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080133174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080133174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:36.268989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10744): Terminating (SIGTERM) 08:01:36.308457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10747): Terminating (SIGTERM) 08:01:36.347957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10750): Terminating (SIGTERM) 08:01:36.387669 --- ParallelTerminationStrategy: PID 10744 died... 08:01:36.406728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10744): Terminated: ok {rc=0} 08:01:36.450800 --- ParallelTerminationStrategy: PID 10747 died... 08:01:36.469411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10747): Terminated: ok {rc=0} 08:01:36.513340 --- ParallelTerminationStrategy: PID 10750 died... 08:01:36.531896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10750): Terminated: ok {rc=0} 08:01:36.617103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:01:37.704284 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:37.716200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:01:37.779075 tst ping_idle_ping.py: using LAC 20060 08:01:37.900479 tst ping_idle_ping.py: using RAC 170 08:01:38.019350 tst ping_idle_ping.py: using CellId 20060 08:01:38.137255 tst ping_idle_ping.py: using BVCI 20061 08:01:38.248933 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.260310 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.271449 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.283275 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.295089 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.306674 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.318594 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:01:38.330341 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:01:38.448877 tst ping_idle_ping.py:24: start network... 08:01:38.648272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:39.112897 run create_hlr_db(pid=10752): Launched 08:01:39.227076 bus /gobi_6: Setting Powered False 08:01:40.287110 run create_hlr_db(pid=10752): Terminated: ok {rc=0} 08:01:40.725129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10754): Launched 08:01:41.045576 run osmo-hlr_10.42.42.2(pid=10755): Launched 08:01:41.169232 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:41.721398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10757): Launched 08:01:42.041683 run osmo-stp_10.42.42.5(pid=10758): Launched 08:01:42.164771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:42.718888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10760): Launched 08:01:42.840757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:43.111787 run patchelf(pid=10761): Launched 08:01:43.289131 run osmo-stp_10.42.42.5(pid=10758): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10758)] 08:01:43.423979 run osmo-stp_10.42.42.5(pid=10758): stdout: | (launched: 2022-12-09_08:01:41.982717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:43.560106 run osmo-stp_10.42.42.5(pid=10758): stderr: | 20221209080142171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080142171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080142172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080142172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080142173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080142173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080142173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:43.697175 run osmo-stp_10.42.42.5(pid=10758): stdout: | (launched: 2022-12-09_08:01:41.982717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:43.828354 run osmo-stp_10.42.42.5(pid=10758): stderr: | 20221209080142171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080142171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080142172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080142172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080142173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080142173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080142173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:43.983233 run patchelf(pid=10761): Terminating (SIGINT) 08:01:44.161585 run patchelf(pid=10761): Terminated: ok {rc=0} 08:01:44.289830 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10758): Process ended prematurely: osmo-stp_10.42.42.5(pid=10758) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10758)] [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:01:44.299433 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:01:44.327459 run osmo-hlr_10.42.42.2(pid=10755): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10755)] 08:01:44.377151 run osmo-hlr_10.42.42.2(pid=10755): stdout: | (launched: 2022-12-09_08:01:40.986527) 08:01:44.428209 run osmo-hlr_10.42.42.2(pid=10755): stderr: | 20221209080141183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080141183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080141183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080141183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080141183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080141183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080141195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080141203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080141203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080141203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:44.480149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10754): Terminating (SIGTERM) 08:01:44.521320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10757): Terminating (SIGTERM) 08:01:44.562930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10760): Terminating (SIGTERM) 08:01:44.605075 --- ParallelTerminationStrategy: PID 10754 died... 08:01:44.625096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10754): Terminated: ok {rc=0} 08:01:44.671073 --- ParallelTerminationStrategy: PID 10757 died... 08:01:44.690448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10757): Terminated: ok {rc=0} 08:01:44.736209 --- ParallelTerminationStrategy: PID 10760 died... 08:01:44.755457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10760): Terminated: ok {rc=0} 08:01:44.842577 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 08:01:46.190140 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:01:46.199296 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:01:46.226331 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:01:46.263687 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:01:46.317914 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:01:46.343001 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:01:46.381595 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:01:46.942930 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:01:46.950113 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:46.962974 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:01:47.025831 tst switch_tch_pdch.py: using LAC 20061 08:01:47.184843 tst switch_tch_pdch.py: using RAC 171 08:01:47.305217 tst switch_tch_pdch.py: using CellId 20061 08:01:47.423344 tst switch_tch_pdch.py: using BVCI 20062 08:01:47.531939 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.543657 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.555139 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.566991 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.578868 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.590556 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.602385 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:01:47.614161 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:01:47.734428 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:01:47.852168 tst switch_tch_pdch.py:51: start network... 08:01:48.052776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:48.516841 run create_hlr_db(pid=10765): Launched 08:01:48.631355 bus /gobi_6: Setting Powered False 08:01:49.691199 run create_hlr_db(pid=10765): Terminated: ok {rc=0} 08:01:50.128224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Launched 08:01:50.451380 run osmo-hlr_10.42.42.2(pid=10768): Launched 08:01:50.576366 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:51.132501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Launched 08:01:51.453082 run osmo-stp_10.42.42.5(pid=10771): Launched 08:01:51.577873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:52.131873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10773): Launched 08:01:52.254919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:52.527340 run patchelf(pid=10774): Launched 08:01:52.707844 run osmo-stp_10.42.42.5(pid=10771): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] 08:01:52.843145 run osmo-stp_10.42.42.5(pid=10771): stdout: | (launched: 2022-12-09_08:01:51.394097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:52.980020 run osmo-stp_10.42.42.5(pid=10771): stderr: | 20221209080151584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080151584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080151585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080151585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080151585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080151586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080151586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:53.116676 run osmo-stp_10.42.42.5(pid=10771): stdout: | (launched: 2022-12-09_08:01:51.394097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:53.247820 run osmo-stp_10.42.42.5(pid=10771): stderr: | 20221209080151584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080151584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080151585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080151585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080151585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080151586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080151586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:53.403255 run patchelf(pid=10774): Terminating (SIGINT) 08:01:53.581170 run patchelf(pid=10774): Terminated: ok {rc=0} 08:01:53.709253 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10771): Process ended prematurely: osmo-stp_10.42.42.5(pid=10771) [trial-2356↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] [trial-2356↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:01:53.718852 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 08:01:53.746763 run osmo-hlr_10.42.42.2(pid=10768): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10768)] 08:01:53.796396 run osmo-hlr_10.42.42.2(pid=10768): stdout: | (launched: 2022-12-09_08:01:50.392395) 08:01:53.847749 run osmo-hlr_10.42.42.2(pid=10768): stderr: | 20221209080150587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080150587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080150587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080150588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080150588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080150588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080150600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080150609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080150609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080150609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:53.899593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Terminating (SIGTERM) 08:01:53.941130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Terminating (SIGTERM) 08:01:53.982833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10773): Terminating (SIGTERM) 08:01:54.024585 --- ParallelTerminationStrategy: PID 10767 died... 08:01:54.044688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Terminated: ok {rc=0} 08:01:54.090681 --- ParallelTerminationStrategy: PID 10770 died... 08:01:54.110296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Terminated: ok {rc=0} 08:01:54.156079 --- ParallelTerminationStrategy: PID 10773 died... 08:01:54.175628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10773): Terminated: ok {rc=0} 08:01:54.262718 bus /gobi_0: Setting Powered False 08:01:55.361540 bus /gobi_0: Setting Powered False 08:01:56.476579 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 sms:nanobts+band-900 --------------------------------------------------------------------- 08:01:57.728650 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:01:57.734071 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:01:57.767665 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:01:57.795364 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 08:01:57.848920 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:01:57.882431 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:01:57.910111 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 08:01:58.455185 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 08:01:58.460370 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:01:58.471301 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 08:01:58.518021 tst mo_mt_sms.py: using LAC 20062 08:01:58.640778 tst mo_mt_sms.py: using RAC 172 08:01:58.757870 tst mo_mt_sms.py: using CellId 20062 08:01:58.872874 tst mo_mt_sms.py: using BVCI 20063 08:01:58.980505 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:01:58.991376 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:01:59.001996 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:01:59.012813 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:01:59.023734 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:01:59.034503 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 08:01:59.152010 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 08:01:59.270921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:59.769805 run create_hlr_db(pid=10779): Launched 08:01:59.901257 bus /gobi_6: Setting Powered False 08:02:00.962177 run create_hlr_db(pid=10779): Terminated: ok {rc=0} 08:02:01.456254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Launched 08:02:01.800073 run osmo-hlr_10.42.42.2(pid=10782): Launched 08:02:02.047526 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:02.662306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Launched 08:02:02.964777 run osmo-stp_10.42.42.5(pid=10785): Launched 08:02:03.078634 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:03.620344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10787): Launched 08:02:03.919410 run osmo-msc_10.42.42.6(pid=10788): Launched 08:02:04.086928 run osmo-stp_10.42.42.5(pid=10785): ERR: Terminated: ERROR {rc=1} [trial-2356↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10785)] 08:02:04.214117 run osmo-stp_10.42.42.5(pid=10785): stdout: | (launched: 2022-12-09_08:02:02.909640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:04.341369 run osmo-stp_10.42.42.5(pid=10785): stderr: | 20221209080203076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080203076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080203076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080203077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080203077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080203077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080203077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:04.467559 run osmo-stp_10.42.42.5(pid=10785): stdout: | (launched: 2022-12-09_08:02:02.909640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:04.586609 run osmo-stp_10.42.42.5(pid=10785): stderr: | 20221209080203076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080203076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080203076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080203077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080203077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080203077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080203077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:04.730000 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10785): Process ended prematurely: osmo-stp_10.42.42.5(pid=10785) [trial-2356↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10785)] [trial-2356↪sms:nanobts+band-900↪mo_mt_sms.py:16] 08:02:04.738263 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 08:02:04.764323 run osmo-hlr_10.42.42.2(pid=10782): ERR: Terminated: ERROR {rc=237} [trial-2356↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10782)] 08:02:04.812179 run osmo-hlr_10.42.42.2(pid=10782): stdout: | (launched: 2022-12-09_08:02:01.740258) 08:02:04.861085 run osmo-hlr_10.42.42.2(pid=10782): stderr: | 20221209080202020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080202020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080202020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080202020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080202020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080202020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080202035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080202047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080202048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080202048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:04.929188 run osmo-msc_10.42.42.6(pid=10788): ERR: Terminated: ERROR {rc=2} [trial-2356↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10788)] 08:02:04.976524 run osmo-msc_10.42.42.6(pid=10788): stdout: | (launched: 2022-12-09_08:02:03.863896) 08:02:05.025607 run osmo-msc_10.42.42.6(pid=10788): stderr: | 20221209080204132 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080204132 DLGLOBAL DEBUG validating counter group 0x7f35afcb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080204132 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080204132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080204132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080204133 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080204134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080204135 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080204135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080204135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:05.075229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Terminating (SIGTERM) 08:02:05.114857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Terminating (SIGTERM) 08:02:05.154549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10787): Terminating (SIGTERM) 08:02:05.194838 --- ParallelTerminationStrategy: PID 10781 died... 08:02:05.214196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Terminated: ok {rc=0} 08:02:05.258838 --- ParallelTerminationStrategy: PID 10784 died... 08:02:05.277249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Terminated: ok {rc=0} 08:02:05.321393 --- ParallelTerminationStrategy: PID 10787 died... 08:02:05.339951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10787): Terminated: ok {rc=0} 08:02:05.423547 bus /sierra_3: Setting Powered False 08:02:06.521599 bus /sierra_3: Setting Powered False 08:02:07.638989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 08:02:08.873599 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:08.878186 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:02:08.911067 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 08:02:08.917867 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 08:02:08.952758 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:02:08.985323 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 08:02:08.992066 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 08:02:09.512357 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 08:02:09.517624 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 08:02:09.528558 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 08:02:09.575377 tst assert_extension.py: using LAC 20063 08:02:09.692918 tst assert_extension.py: using RAC 173 08:02:09.812001 tst assert_extension.py: using CellId 20063 08:02:09.939282 tst assert_extension.py: using BVCI 20064 08:02:10.055737 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 08:02:10.175442 tst assert_extension.py:10: start nitb and bts... 08:02:10.391069 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:02:11.046885 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10794): Launched 08:02:11.367975 run osmo-nitb_10.42.42.2(pid=10795): Launched 08:02:11.544850 run osmo-nitb_10.42.42.2(pid=10795): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10795)] 08:02:11.688736 run osmo-nitb_10.42.42.2(pid=10795): stdout: | (launched: 2022-12-09_08:02:11.309342) 08:02:11.832857 run osmo-nitb_10.42.42.2(pid=10795): stderr: | (launched: 2022-12-09_08:02:11.356884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:02:11.977732 run osmo-nitb_10.42.42.2(pid=10795): stdout: | (launched: 2022-12-09_08:02:11.309342) 08:02:12.116698 run osmo-nitb_10.42.42.2(pid=10795): stderr: | (launched: 2022-12-09_08:02:11.356884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10795): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10795) [trial-2356↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10795)] 08:02:12.488549 tst osmo-nitb_10.42.42.2(pid=10795): stdout: | (launched: 2022-12-09_08:02:11.309342) 08:02:12.617627 tst osmo-nitb_10.42.42.2(pid=10795): stderr: | (launched: 2022-12-09_08:02:11.356884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:02:12.770762 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10795): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10795) [trial-2356↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10795)] [trial-2356↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 08:02:12.779662 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:02:12.786703 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10794): Terminating (SIGTERM) 08:02:12.998131 --- ParallelTerminationStrategy: PID 10794 died... 08:02:13.019929 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10794): Terminated: ok {rc=0} 08:02:13.107973 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 ussd:nanobts+band-900 --------------------------------------------------------------------- 08:02:14.282875 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:14.289536 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:02:14.323732 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:02:14.351754 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 08:02:14.387950 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:02:14.421570 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:02:14.449423 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 08:02:14.980762 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 08:02:14.986302 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:14.997758 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 08:02:15.045512 tst assert_extension.py: using LAC 20064 08:02:15.173106 tst assert_extension.py: using RAC 174 08:02:15.292029 tst assert_extension.py: using CellId 20064 08:02:15.410408 tst assert_extension.py: using BVCI 20065 08:02:15.526763 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:15.538160 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:15.549308 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:15.560662 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:15.571819 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:15.582916 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 08:02:15.697671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:16.196315 run create_hlr_db(pid=10799): Launched 08:02:16.362203 bus /sierra_2: Setting Powered False 08:02:17.425331 run create_hlr_db(pid=10799): Terminated: ok {rc=0} 08:02:17.874629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Launched 08:02:18.195997 run osmo-hlr_10.42.42.2(pid=10802): Launched 08:02:18.317409 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:18.871989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Launched 08:02:19.194540 run osmo-stp_10.42.42.5(pid=10805): Launched 08:02:19.316390 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:19.894486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Launched 08:02:20.215678 run osmo-msc_10.42.42.6(pid=10808): Launched 08:02:20.395865 run osmo-stp_10.42.42.5(pid=10805): ERR: Terminated: ERROR {rc=1} [trial-2356↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] 08:02:20.530694 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-09_08:02:19.134855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:20.666106 run osmo-stp_10.42.42.5(pid=10805): stderr: | 20221209080219324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080219324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080219324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080219325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080219325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080219325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080219326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:20.800015 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-09_08:02:19.134855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:20.927411 run osmo-stp_10.42.42.5(pid=10805): stderr: | 20221209080219324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080219324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080219324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080219325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080219325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080219325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080219326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:21.079689 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2356↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] [trial-2356↪ussd:nanobts+band-900↪assert_extension.py:17] 08:02:21.088505 tst assert_extension.py:17: Test FAILED (6.1 sec) 08:02:21.116421 run osmo-hlr_10.42.42.2(pid=10802): ERR: Terminated: ERROR {rc=237} [trial-2356↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10802)] 08:02:21.166088 run osmo-hlr_10.42.42.2(pid=10802): stdout: | (launched: 2022-12-09_08:02:18.137239) 08:02:21.217651 run osmo-hlr_10.42.42.2(pid=10802): stderr: | 20221209080218332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080218332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080218332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080218332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080218332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080218332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080218349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080218357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080218357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080218357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:21.289534 run osmo-msc_10.42.42.6(pid=10808): ERR: Terminated: ERROR {rc=2} [trial-2356↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10808)] 08:02:21.339384 run osmo-msc_10.42.42.6(pid=10808): stdout: | (launched: 2022-12-09_08:02:20.156933) 08:02:21.390797 run osmo-msc_10.42.42.6(pid=10808): stderr: | 20221209080220474 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080220474 DLGLOBAL DEBUG validating counter group 0x7f16283e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080220474 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080220475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080220475 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080220475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080220477 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080220477 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080220477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080220477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:21.442764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminating (SIGTERM) 08:02:21.484083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminating (SIGTERM) 08:02:21.525536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Terminating (SIGTERM) 08:02:21.567255 --- ParallelTerminationStrategy: PID 10801 died... 08:02:21.587457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminated: ok {rc=0} 08:02:21.633384 --- ParallelTerminationStrategy: PID 10804 died... 08:02:21.652935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminated: ok {rc=0} 08:02:21.698716 --- ParallelTerminationStrategy: PID 10807 died... 08:02:21.718149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Terminated: ok {rc=0} 08:02:21.804592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:02:23.016909 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:23.024634 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:02:23.059770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:02:23.086647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:02:23.139216 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:02:23.172334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:02:23.199006 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:02:23.750851 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:02:23.801693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:23.813101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:02:23.880742 tst mo_mt_call.py: using LAC 20065 08:02:23.999351 tst mo_mt_call.py: using RAC 175 08:02:24.119338 tst mo_mt_call.py: using CellId 20065 08:02:24.239823 tst mo_mt_call.py: using BVCI 20066 08:02:24.351913 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:24.363220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:24.374392 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:24.385755 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:24.397400 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:24.408869 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:02:24.529864 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:02:24.647505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:25.118584 run create_hlr_db(pid=10813): Launched 08:02:25.234471 bus /sierra_2: Setting Powered False 08:02:26.294781 run create_hlr_db(pid=10813): Terminated: ok {rc=0} 08:02:26.739053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10815): Launched 08:02:27.067771 run osmo-hlr_10.42.42.2(pid=10816): Launched 08:02:27.192515 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:27.757944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10818): Launched 08:02:28.083135 run osmo-stp_10.42.42.5(pid=10819): Launched 08:02:28.206699 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:28.795940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10821): Launched 08:02:29.125069 run osmo-msc_10.42.42.6(pid=10822): Launched 08:02:29.308006 run osmo-stp_10.42.42.5(pid=10819): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10819)] 08:02:29.445405 run osmo-stp_10.42.42.5(pid=10819): stdout: | (launched: 2022-12-09_08:02:28.023073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:29.582726 run osmo-stp_10.42.42.5(pid=10819): stderr: | 20221209080228213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080228213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080228214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080228214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080228215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080228215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080228215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:29.718824 run osmo-stp_10.42.42.5(pid=10819): stdout: | (launched: 2022-12-09_08:02:28.023073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:29.848236 run osmo-stp_10.42.42.5(pid=10819): stderr: | 20221209080228213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080228213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080228214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080228214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080228215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080228215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080228215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:30.003626 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10819): Process ended prematurely: osmo-stp_10.42.42.5(pid=10819) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10819)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:02:30.013166 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:02:30.041045 run osmo-hlr_10.42.42.2(pid=10816): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10816)] 08:02:30.090720 run osmo-hlr_10.42.42.2(pid=10816): stdout: | (launched: 2022-12-09_08:02:27.007565) 08:02:30.142086 run osmo-hlr_10.42.42.2(pid=10816): stderr: | 20221209080227204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080227204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080227204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080227204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080227204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080227204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080227216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080227227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080227227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080227227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:30.214148 run osmo-msc_10.42.42.6(pid=10822): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10822)] 08:02:30.263885 run osmo-msc_10.42.42.6(pid=10822): stdout: | (launched: 2022-12-09_08:02:29.064718) 08:02:30.315302 run osmo-msc_10.42.42.6(pid=10822): stderr: | 20221209080229386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080229386 DLGLOBAL DEBUG validating counter group 0x7fb8f5cb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080229386 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080229386 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080229387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080229387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080229388 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080229389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080229389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080229389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:30.366991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10815): Terminating (SIGTERM) 08:02:30.408388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10818): Terminating (SIGTERM) 08:02:30.450228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10821): Terminating (SIGTERM) 08:02:30.492048 --- ParallelTerminationStrategy: PID 10815 died... 08:02:30.512102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10815): Terminated: ok {rc=0} 08:02:30.558038 --- ParallelTerminationStrategy: PID 10818 died... 08:02:30.577486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10818): Terminated: ok {rc=0} 08:02:30.623608 --- ParallelTerminationStrategy: PID 10821 died... 08:02:30.643280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10821): Terminated: ok {rc=0} 08:02:30.730661 bus /sierra_3: Setting Powered False 08:02:31.826876 bus /sierra_3: Setting Powered False 08:02:32.942427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:02:34.091986 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:34.104726 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:02:34.174570 tst mo_mt_call_osmux.py: using LAC 20066 08:02:34.307202 tst mo_mt_call_osmux.py: using RAC 176 08:02:34.433844 tst mo_mt_call_osmux.py: using CellId 20066 08:02:34.559509 tst mo_mt_call_osmux.py: using BVCI 20067 08:02:34.678171 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:34.690000 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:34.701612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:34.713215 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:34.724816 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:02:34.736425 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:02:34.851947 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:02:34.974828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:35.481877 run create_hlr_db(pid=10824): Launched 08:02:35.615418 bus /sierra_2: Setting Powered False 08:02:36.679817 run create_hlr_db(pid=10824): Terminated: ok {rc=0} 08:02:37.114365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10827): Launched 08:02:37.439882 run osmo-hlr_10.42.42.2(pid=10828): Launched 08:02:37.566141 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:38.127279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10830): Launched 08:02:38.454852 run osmo-stp_10.42.42.5(pid=10831): Launched 08:02:38.578208 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:39.169117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Launched 08:02:39.494682 run osmo-msc_10.42.42.6(pid=10834): Launched 08:02:39.677356 run osmo-stp_10.42.42.5(pid=10831): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10831)] 08:02:39.814951 run osmo-stp_10.42.42.5(pid=10831): stdout: | (launched: 2022-12-09_08:02:38.394812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:39.952276 run osmo-stp_10.42.42.5(pid=10831): stderr: | 20221209080238586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080238586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080238586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080238586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080238587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080238587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080238587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:40.088037 run osmo-stp_10.42.42.5(pid=10831): stdout: | (launched: 2022-12-09_08:02:38.394812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:40.217852 run osmo-stp_10.42.42.5(pid=10831): stderr: | 20221209080238586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080238586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080238586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080238586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080238587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080238587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080238587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:40.373860 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10831): Process ended prematurely: osmo-stp_10.42.42.5(pid=10831) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10831)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:02:40.383750 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:02:40.411639 run osmo-hlr_10.42.42.2(pid=10828): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10828)] 08:02:40.461206 run osmo-hlr_10.42.42.2(pid=10828): stdout: | (launched: 2022-12-09_08:02:37.380265) 08:02:40.512589 run osmo-hlr_10.42.42.2(pid=10828): stderr: | 20221209080237577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080237577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080237577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080237577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080237577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080237577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080237596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080237606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080237606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080237606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:40.584245 run osmo-msc_10.42.42.6(pid=10834): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10834)] 08:02:40.633996 run osmo-msc_10.42.42.6(pid=10834): stdout: | (launched: 2022-12-09_08:02:39.435078) 08:02:40.685288 run osmo-msc_10.42.42.6(pid=10834): stderr: | 20221209080239756 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080239756 DLGLOBAL DEBUG validating counter group 0x7fef1155cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080239756 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080239756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080239756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080239756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080239758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080239758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080239759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080239759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:40.737291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10827): Terminating (SIGTERM) 08:02:40.778692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10830): Terminating (SIGTERM) 08:02:40.820327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Terminating (SIGTERM) 08:02:40.862314 --- ParallelTerminationStrategy: PID 10827 died... 08:02:40.882401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10827): Terminated: ok {rc=0} 08:02:40.928579 --- ParallelTerminationStrategy: PID 10830 died... 08:02:40.948211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10830): Terminated: ok {rc=0} 08:02:40.993647 --- ParallelTerminationStrategy: PID 10833 died... 08:02:41.013055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Terminated: ok {rc=0} 08:02:41.099848 bus /sierra_3: Setting Powered False 08:02:42.199103 bus /sierra_3: Setting Powered False 08:02:43.312872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:02:44.564587 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:44.571751 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:02:44.604930 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:02:44.631675 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:02:44.683829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:02:44.716308 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:02:44.743053 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:02:45.300220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:02:45.353254 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:45.365338 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:02:45.433399 tst mo_mt_call.py: using LAC 20067 08:02:45.560533 tst mo_mt_call.py: using RAC 177 08:02:45.679479 tst mo_mt_call.py: using CellId 20067 08:02:45.801511 tst mo_mt_call.py: using BVCI 20068 08:02:45.945409 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:45.957989 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:45.970164 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:45.982597 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:45.995289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:46.007578 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:02:46.133679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:02:46.288107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:46.830669 run create_hlr_db(pid=10839): Launched 08:02:47.013957 bus /sierra_2: Setting Powered False 08:02:48.074631 run create_hlr_db(pid=10839): Terminated: ok {rc=0} 08:02:48.519118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10841): Launched 08:02:48.846190 run osmo-hlr_10.42.42.2(pid=10842): Launched 08:02:48.969160 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:49.528794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10844): Launched 08:02:49.856533 run osmo-stp_10.42.42.5(pid=10845): Launched 08:02:49.979511 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:50.566655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10847): Launched 08:02:50.893426 run osmo-msc_10.42.42.6(pid=10848): Launched 08:02:51.074646 run osmo-stp_10.42.42.5(pid=10845): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10845)] 08:02:51.210807 run osmo-stp_10.42.42.5(pid=10845): stdout: | (launched: 2022-12-09_08:02:49.796253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:51.347252 run osmo-stp_10.42.42.5(pid=10845): stderr: | 20221209080249987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080249987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080249988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080249988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080249989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080249989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080249989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:51.483290 run osmo-stp_10.42.42.5(pid=10845): stdout: | (launched: 2022-12-09_08:02:49.796253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:51.613222 run osmo-stp_10.42.42.5(pid=10845): stderr: | 20221209080249987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080249987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080249988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080249988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080249989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080249989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080249989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:51.768642 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10845): Process ended prematurely: osmo-stp_10.42.42.5(pid=10845) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10845)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:02:51.778476 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:02:51.806454 run osmo-hlr_10.42.42.2(pid=10842): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10842)] 08:02:51.858117 run osmo-hlr_10.42.42.2(pid=10842): stdout: | (launched: 2022-12-09_08:02:48.786838) 08:02:51.909928 run osmo-hlr_10.42.42.2(pid=10842): stderr: | 20221209080248981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080248982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080248982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080248982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080248982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080248982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080249053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080249063 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080249063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080249063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:51.981768 run osmo-msc_10.42.42.6(pid=10848): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10848)] 08:02:52.031359 run osmo-msc_10.42.42.6(pid=10848): stdout: | (launched: 2022-12-09_08:02:50.833415) 08:02:52.082608 run osmo-msc_10.42.42.6(pid=10848): stderr: | 20221209080251155 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080251155 DLGLOBAL DEBUG validating counter group 0x7fa731366c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080251155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080251155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080251155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080251155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080251157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080251157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080251158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080251158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:52.134199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10841): Terminating (SIGTERM) 08:02:52.175558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10844): Terminating (SIGTERM) 08:02:52.217222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10847): Terminating (SIGTERM) 08:02:52.259257 --- ParallelTerminationStrategy: PID 10841 died... 08:02:52.278870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10841): Terminated: ok {rc=0} 08:02:52.325269 --- ParallelTerminationStrategy: PID 10844 died... 08:02:52.345124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10844): Terminated: ok {rc=0} 08:02:52.391195 --- ParallelTerminationStrategy: PID 10847 died... 08:02:52.410852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10847): Terminated: ok {rc=0} 08:02:52.498684 bus /sierra_3: Setting Powered False 08:02:53.598652 bus /sierra_3: Setting Powered False 08:02:54.713662 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:02:55.862743 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:55.875449 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:02:55.945672 tst mo_mt_call_osmux.py: using LAC 20068 08:02:56.077959 tst mo_mt_call_osmux.py: using RAC 178 08:02:56.201433 tst mo_mt_call_osmux.py: using CellId 20068 08:02:56.320041 tst mo_mt_call_osmux.py: using BVCI 20069 08:02:56.430443 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:56.441989 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:56.453391 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:56.464865 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:56.476308 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:02:56.487711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:02:56.604170 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:02:56.725590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:57.230905 run create_hlr_db(pid=10850): Launched 08:02:57.365486 bus /sierra_2: Setting Powered False 08:02:58.430184 run create_hlr_db(pid=10850): Terminated: ok {rc=0} 08:02:58.864293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10852): Launched 08:02:59.192880 run osmo-hlr_10.42.42.2(pid=10853): Launched 08:02:59.316000 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:59.878708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10855): Launched 08:03:00.204427 run osmo-stp_10.42.42.5(pid=10856): Launched 08:03:00.328627 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:00.933951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10858): Launched 08:03:01.289678 run osmo-msc_10.42.42.6(pid=10860): Launched 08:03:01.501378 run osmo-stp_10.42.42.5(pid=10856): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10856)] 08:03:01.676205 run osmo-stp_10.42.42.5(pid=10856): stdout: | (launched: 2022-12-09_08:03:00.144349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:01.963886 run osmo-stp_10.42.42.5(pid=10856): stderr: | 20221209080300333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080300333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080300333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080300334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080300334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080300334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080300334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:02.327462 run osmo-stp_10.42.42.5(pid=10856): stdout: | (launched: 2022-12-09_08:03:00.144349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:02.455990 run osmo-stp_10.42.42.5(pid=10856): stderr: | 20221209080300333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080300333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080300333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080300334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080300334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080300334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080300334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:02.603628 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10856): Process ended prematurely: osmo-stp_10.42.42.5(pid=10856) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10856)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:03:02.612939 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 08:03:02.639956 run osmo-hlr_10.42.42.2(pid=10853): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10853)] 08:03:02.688094 run osmo-hlr_10.42.42.2(pid=10853): stdout: | (launched: 2022-12-09_08:02:59.132862) 08:03:02.737433 run osmo-hlr_10.42.42.2(pid=10853): stderr: | 20221209080259329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080259329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080259329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080259329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080259329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080259329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080259342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080259351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080259351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080259351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:02.806299 run osmo-msc_10.42.42.6(pid=10860): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10860)] 08:03:02.853791 run osmo-msc_10.42.42.6(pid=10860): stdout: | (launched: 2022-12-09_08:03:01.229667) 08:03:02.902734 run osmo-msc_10.42.42.6(pid=10860): stderr: | 20221209080301912 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080301914 DLGLOBAL DEBUG validating counter group 0x7fd280f91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080301914 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080301915 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080301915 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080301918 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080301922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080301923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080301923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080301923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:02.952166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10852): Terminating (SIGTERM) 08:03:02.991636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10855): Terminating (SIGTERM) 08:03:03.031091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10858): Terminating (SIGTERM) 08:03:03.070865 --- ParallelTerminationStrategy: PID 10852 died... 08:03:03.090196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10852): Terminated: ok {rc=0} 08:03:03.135224 --- ParallelTerminationStrategy: PID 10855 died... 08:03:03.153940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10855): Terminated: ok {rc=0} 08:03:03.198398 --- ParallelTerminationStrategy: PID 10858 died... 08:03:03.217142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10858): Terminated: ok {rc=0} 08:03:03.301310 bus /sierra_3: Setting Powered False 08:03:04.397504 bus /sierra_3: Setting Powered False 08:03:05.508399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:03:06.761024 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:03:06.769344 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:03:06.803160 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:03:06.830953 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:03:06.884376 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:03:06.918101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:03:06.945557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:03:07.500172 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:03:07.552108 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:07.563926 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:03:07.633407 tst mo_mt_call.py: using LAC 20069 08:03:07.761401 tst mo_mt_call.py: using RAC 179 08:03:07.889384 tst mo_mt_call.py: using CellId 20069 08:03:08.017007 tst mo_mt_call.py: using BVCI 20070 08:03:08.135204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:08.147042 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:08.158698 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:08.170428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:08.182133 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:08.193801 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:03:08.309537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:03:08.430519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:08.936760 run create_hlr_db(pid=10865): Launched 08:03:09.069881 bus /sierra_2: Setting Powered False 08:03:10.134743 run create_hlr_db(pid=10865): Terminated: ok {rc=0} 08:03:10.570228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10867): Launched 08:03:10.877133 run osmo-hlr_10.42.42.2(pid=10868): Launched 08:03:10.993433 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:11.529488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10870): Launched 08:03:11.833235 run osmo-stp_10.42.42.5(pid=10871): Launched 08:03:11.950529 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:12.500056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10873): Launched 08:03:12.806244 run osmo-msc_10.42.42.6(pid=10874): Launched 08:03:12.976153 run osmo-stp_10.42.42.5(pid=10871): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10871)] 08:03:13.105196 run osmo-stp_10.42.42.5(pid=10871): stdout: | (launched: 2022-12-09_08:03:11.776858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:13.234314 run osmo-stp_10.42.42.5(pid=10871): stderr: | 20221209080311944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080311944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080311944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080311944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080311945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080311945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080311945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:13.360912 run osmo-stp_10.42.42.5(pid=10871): stdout: | (launched: 2022-12-09_08:03:11.776858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:13.482127 run osmo-stp_10.42.42.5(pid=10871): stderr: | 20221209080311944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080311944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080311944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080311944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080311945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080311945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080311945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:13.627481 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10871): Process ended prematurely: osmo-stp_10.42.42.5(pid=10871) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10871)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:03:13.636539 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:03:13.663497 run osmo-hlr_10.42.42.2(pid=10868): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10868)] 08:03:13.710747 run osmo-hlr_10.42.42.2(pid=10868): stdout: | (launched: 2022-12-09_08:03:10.821135) 08:03:13.759834 run osmo-hlr_10.42.42.2(pid=10868): stderr: | 20221209080310996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080310996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080310996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080310996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080310996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080310996 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080311011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080311022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080311022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080311022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:13.828736 run osmo-msc_10.42.42.6(pid=10874): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10874)] 08:03:13.876721 run osmo-msc_10.42.42.6(pid=10874): stdout: | (launched: 2022-12-09_08:03:12.749816) 08:03:13.925584 run osmo-msc_10.42.42.6(pid=10874): stderr: | 20221209080313018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080313018 DLGLOBAL DEBUG validating counter group 0x7f27227b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080313018 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080313018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080313019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080313019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080313020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080313021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080313021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080313021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:13.974916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10867): Terminating (SIGTERM) 08:03:14.014247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10870): Terminating (SIGTERM) 08:03:14.053564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10873): Terminating (SIGTERM) 08:03:14.093263 --- ParallelTerminationStrategy: PID 10867 died... 08:03:14.112234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10867): Terminated: ok {rc=0} 08:03:14.156474 --- ParallelTerminationStrategy: PID 10870 died... 08:03:14.175017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10870): Terminated: ok {rc=0} 08:03:14.218850 --- ParallelTerminationStrategy: PID 10873 died... 08:03:14.237442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10873): Terminated: ok {rc=0} 08:03:14.322436 bus /sierra_3: Setting Powered False 08:03:15.421179 bus /sierra_3: Setting Powered False 08:03:16.535268 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:03:17.687938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:17.700636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:03:17.774236 tst mo_mt_call_osmux.py: using LAC 20070 08:03:17.894525 tst mo_mt_call_osmux.py: using RAC 180 08:03:18.015610 tst mo_mt_call_osmux.py: using CellId 20070 08:03:18.134416 tst mo_mt_call_osmux.py: using BVCI 20071 08:03:18.245466 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:18.256764 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:18.268118 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:18.279976 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:18.291647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:03:18.303120 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:03:18.419337 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:03:18.541911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:19.016506 run create_hlr_db(pid=10876): Launched 08:03:19.132898 bus /sierra_2: Setting Powered False 08:03:20.194395 run create_hlr_db(pid=10876): Terminated: ok {rc=0} 08:03:20.643050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10878): Launched 08:03:20.972701 run osmo-hlr_10.42.42.2(pid=10879): Launched 08:03:21.097549 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:21.663156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Launched 08:03:21.990591 run osmo-stp_10.42.42.5(pid=10882): Launched 08:03:22.116319 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:22.707923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10884): Launched 08:03:23.036535 run osmo-msc_10.42.42.6(pid=10885): Launched 08:03:23.218980 run osmo-stp_10.42.42.5(pid=10882): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] 08:03:23.356884 run osmo-stp_10.42.42.5(pid=10882): stdout: | (launched: 2022-12-09_08:03:21.931248) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:23.494399 run osmo-stp_10.42.42.5(pid=10882): stderr: | 20221209080322118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080322118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080322118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080322119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080322119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080322119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080322119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:23.630974 run osmo-stp_10.42.42.5(pid=10882): stdout: | (launched: 2022-12-09_08:03:21.931248) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:23.761118 run osmo-stp_10.42.42.5(pid=10882): stderr: | 20221209080322118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080322118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080322118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080322119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080322119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080322119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080322119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:23.916406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10882): Process ended prematurely: osmo-stp_10.42.42.5(pid=10882) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:03:23.926247 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:03:23.953905 run osmo-hlr_10.42.42.2(pid=10879): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10879)] 08:03:24.003943 run osmo-hlr_10.42.42.2(pid=10879): stdout: | (launched: 2022-12-09_08:03:20.912502) 08:03:24.055195 run osmo-hlr_10.42.42.2(pid=10879): stderr: | 20221209080321108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080321108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080321108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080321108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080321108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080321109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080321121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080321130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080321130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080321130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:24.126644 run osmo-msc_10.42.42.6(pid=10885): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10885)] 08:03:24.176156 run osmo-msc_10.42.42.6(pid=10885): stdout: | (launched: 2022-12-09_08:03:22.976387) 08:03:24.227109 run osmo-msc_10.42.42.6(pid=10885): stderr: | 20221209080323297 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080323297 DLGLOBAL DEBUG validating counter group 0x7fe3ae459c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080323298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080323298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080323298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080323298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080323300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080323300 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080323300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080323300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:24.278533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10878): Terminating (SIGTERM) 08:03:24.319874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Terminating (SIGTERM) 08:03:24.361165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10884): Terminating (SIGTERM) 08:03:24.403008 --- ParallelTerminationStrategy: PID 10878 died... 08:03:24.422923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10878): Terminated: ok {rc=0} 08:03:24.468772 --- ParallelTerminationStrategy: PID 10881 died... 08:03:24.488158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Terminated: ok {rc=0} 08:03:24.533986 --- ParallelTerminationStrategy: PID 10884 died... 08:03:24.553559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10884): Terminated: ok {rc=0} 08:03:24.640404 bus /sierra_3: Setting Powered False 08:03:25.738619 bus /sierra_3: Setting Powered False 08:03:26.853322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:03:28.108031 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:03:28.116411 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:03:28.149911 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:03:28.177690 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:03:28.230852 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:03:28.264129 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:03:28.291766 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:03:28.846919 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:03:28.898739 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:28.910502 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:03:28.979259 tst mo_mt_call.py: using LAC 20071 08:03:29.106969 tst mo_mt_call.py: using RAC 181 08:03:29.235500 tst mo_mt_call.py: using CellId 20071 08:03:29.363360 tst mo_mt_call.py: using BVCI 20072 08:03:29.482867 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:29.494994 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:29.506579 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:29.518219 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:29.529977 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:29.541583 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:03:29.656695 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:03:29.772811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:30.279161 run create_hlr_db(pid=10890): Launched 08:03:30.412411 bus /sierra_2: Setting Powered False 08:03:31.474755 run create_hlr_db(pid=10890): Terminated: ok {rc=0} 08:03:31.945300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10892): Launched 08:03:32.287175 run osmo-hlr_10.42.42.2(pid=10893): Launched 08:03:32.412593 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:32.973254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10895): Launched 08:03:33.299037 run osmo-stp_10.42.42.5(pid=10896): Launched 08:03:33.423391 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:34.012925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10898): Launched 08:03:34.341046 run osmo-msc_10.42.42.6(pid=10899): Launched 08:03:34.522376 run osmo-stp_10.42.42.5(pid=10896): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10896)] 08:03:34.659444 run osmo-stp_10.42.42.5(pid=10896): stdout: | (launched: 2022-12-09_08:03:33.239430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:34.796785 run osmo-stp_10.42.42.5(pid=10896): stderr: | 20221209080333428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080333428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080333429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080333429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080333429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080333430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080333430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:34.932417 run osmo-stp_10.42.42.5(pid=10896): stdout: | (launched: 2022-12-09_08:03:33.239430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:35.062264 run osmo-stp_10.42.42.5(pid=10896): stderr: | 20221209080333428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080333428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080333429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080333429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080333429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080333430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080333430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:35.217416 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10896): Process ended prematurely: osmo-stp_10.42.42.5(pid=10896) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10896)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:03:35.227080 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:03:35.254856 run osmo-hlr_10.42.42.2(pid=10893): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10893)] 08:03:35.304210 run osmo-hlr_10.42.42.2(pid=10893): stdout: | (launched: 2022-12-09_08:03:32.227358) 08:03:35.355701 run osmo-hlr_10.42.42.2(pid=10893): stderr: | 20221209080332422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080332422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080332423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080332423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080332423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080332423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080332435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080332444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080332444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080332444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:35.427533 run osmo-msc_10.42.42.6(pid=10899): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10899)] 08:03:35.477094 run osmo-msc_10.42.42.6(pid=10899): stdout: | (launched: 2022-12-09_08:03:34.281232) 08:03:35.528288 run osmo-msc_10.42.42.6(pid=10899): stderr: | 20221209080334602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080334602 DLGLOBAL DEBUG validating counter group 0x7fc358cb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080334602 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080334602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080334602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080334603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080334604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080334605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080334605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080334605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:35.579765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10892): Terminating (SIGTERM) 08:03:35.621097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10895): Terminating (SIGTERM) 08:03:35.662881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10898): Terminating (SIGTERM) 08:03:35.704828 --- ParallelTerminationStrategy: PID 10892 died... 08:03:35.724742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10892): Terminated: ok {rc=0} 08:03:35.770990 --- ParallelTerminationStrategy: PID 10895 died... 08:03:35.790378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10895): Terminated: ok {rc=0} 08:03:35.836068 --- ParallelTerminationStrategy: PID 10898 died... 08:03:35.855555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10898): Terminated: ok {rc=0} 08:03:35.941928 bus /sierra_3: Setting Powered False 08:03:37.041347 bus /sierra_3: Setting Powered False 08:03:38.156567 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:03:39.305310 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:39.317789 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:03:39.389472 tst mo_mt_call_osmux.py: using LAC 20072 08:03:39.510706 tst mo_mt_call_osmux.py: using RAC 182 08:03:39.637070 tst mo_mt_call_osmux.py: using CellId 20072 08:03:39.756103 tst mo_mt_call_osmux.py: using BVCI 20073 08:03:39.876358 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:39.888122 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:39.899702 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:39.911345 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:39.923082 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:03:39.934690 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:03:40.053803 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:03:40.175374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:40.645317 run create_hlr_db(pid=10902): Launched 08:03:40.761421 bus /sierra_2: Setting Powered False 08:03:41.822322 run create_hlr_db(pid=10902): Terminated: ok {rc=0} 08:03:42.245623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10904): Launched 08:03:42.549724 run osmo-hlr_10.42.42.2(pid=10905): Launched 08:03:42.666567 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:43.200705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10919): Launched 08:03:43.528925 run osmo-stp_10.42.42.5(pid=10920): Launched 08:03:43.654766 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:44.242063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10922): Launched 08:03:44.571151 run osmo-msc_10.42.42.6(pid=10923): Launched 08:03:44.754332 run osmo-stp_10.42.42.5(pid=10920): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10920)] 08:03:44.892161 run osmo-stp_10.42.42.5(pid=10920): stdout: | (launched: 2022-12-09_08:03:43.469167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:45.030959 run osmo-stp_10.42.42.5(pid=10920): stderr: | 20221209080343660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080343660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080343661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080343661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080343662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080343662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080343662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:45.166804 run osmo-stp_10.42.42.5(pid=10920): stdout: | (launched: 2022-12-09_08:03:43.469167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:45.296870 run osmo-stp_10.42.42.5(pid=10920): stderr: | 20221209080343660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080343660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080343661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080343661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080343662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080343662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080343662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:45.453114 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10920): Process ended prematurely: osmo-stp_10.42.42.5(pid=10920) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10920)] [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:03:45.462719 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:03:45.490361 run osmo-hlr_10.42.42.2(pid=10905): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10905)] 08:03:45.539619 run osmo-hlr_10.42.42.2(pid=10905): stdout: | (launched: 2022-12-09_08:03:42.493841) 08:03:45.590993 run osmo-hlr_10.42.42.2(pid=10905): stderr: | 20221209080342669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080342669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080342669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080342669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080342669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080342669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080342682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080342690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080342690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080342690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:45.662938 run osmo-msc_10.42.42.6(pid=10923): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10923)] 08:03:45.712557 run osmo-msc_10.42.42.6(pid=10923): stdout: | (launched: 2022-12-09_08:03:44.509389) 08:03:45.763448 run osmo-msc_10.42.42.6(pid=10923): stderr: | 20221209080344830 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080344831 DLGLOBAL DEBUG validating counter group 0x7fe74576cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080344831 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080344831 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080344831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080344831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080344833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080344833 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080344833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080344834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:45.814693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10904): Terminating (SIGTERM) 08:03:45.856707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10919): Terminating (SIGTERM) 08:03:45.906305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10922): Terminating (SIGTERM) 08:03:45.950252 --- ParallelTerminationStrategy: PID 10904 died... 08:03:45.970293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10904): Terminated: ok {rc=0} 08:03:46.016624 --- ParallelTerminationStrategy: PID 10919 died... 08:03:46.036383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10919): Terminated: ok {rc=0} 08:03:46.082965 --- ParallelTerminationStrategy: PID 10922 died... 08:03:46.103030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10922): Terminated: ok {rc=0} 08:03:46.192735 bus /sierra_3: Setting Powered False 08:03:47.291946 bus /sierra_3: Setting Powered False 08:03:48.407255 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:03:49.659324 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:03:49.666623 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:03:49.699433 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:03:49.726333 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:03:49.779812 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:03:49.813745 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:03:49.841664 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:03:50.390962 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:03:50.440346 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:03:50.451839 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:03:50.518733 tst mo_mt_call.py: using LAC 20073 08:03:50.638723 tst mo_mt_call.py: using RAC 183 08:03:50.759900 tst mo_mt_call.py: using CellId 20073 08:03:50.880546 tst mo_mt_call.py: using BVCI 20074 08:03:50.992233 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:03:51.003644 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:03:51.014835 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:03:51.026377 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:03:51.037867 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:03:51.049278 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:03:51.170890 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:03:51.292141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:51.765664 run create_hlr_db(pid=10928): Launched 08:03:51.880661 bus /sierra_2: Setting Powered False 08:03:52.941318 run create_hlr_db(pid=10928): Terminated: ok {rc=0} 08:03:53.387493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10930): Launched 08:03:53.715365 run osmo-hlr_10.42.42.2(pid=10931): Launched 08:03:53.838821 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:54.398839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10933): Launched 08:03:54.729711 run osmo-stp_10.42.42.5(pid=10934): Launched 08:03:54.850382 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:55.403418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10936): Launched 08:03:55.708774 run osmo-msc_10.42.42.6(pid=10937): Launched 08:03:55.878026 run osmo-stp_10.42.42.5(pid=10934): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10934)] 08:03:56.005698 run osmo-stp_10.42.42.5(pid=10934): stdout: | (launched: 2022-12-09_08:03:54.666396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:56.134269 run osmo-stp_10.42.42.5(pid=10934): stderr: | 20221209080354844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080354844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080354844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080354845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080354845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080354845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080354845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:56.260699 run osmo-stp_10.42.42.5(pid=10934): stdout: | (launched: 2022-12-09_08:03:54.666396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:56.381691 run osmo-stp_10.42.42.5(pid=10934): stderr: | 20221209080354844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080354844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080354844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080354845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080354845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080354845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080354845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:56.526854 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10934): Process ended prematurely: osmo-stp_10.42.42.5(pid=10934) [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10934)] [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:03:56.535942 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:03:56.562865 run osmo-hlr_10.42.42.2(pid=10931): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10931)] 08:03:56.610763 run osmo-hlr_10.42.42.2(pid=10931): stdout: | (launched: 2022-12-09_08:03:53.655314) 08:03:56.659857 run osmo-hlr_10.42.42.2(pid=10931): stderr: | 20221209080353853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080353853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080353853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080353853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080353853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080353853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080353869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080353879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080353880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080353880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:56.728322 run osmo-msc_10.42.42.6(pid=10937): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10937)] 08:03:56.775834 run osmo-msc_10.42.42.6(pid=10937): stdout: | (launched: 2022-12-09_08:03:55.652400) 08:03:56.824911 run osmo-msc_10.42.42.6(pid=10937): stderr: | 20221209080355923 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080355923 DLGLOBAL DEBUG validating counter group 0x7fd6ba1b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080355923 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080355923 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080355923 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080355923 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080355925 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080355926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080355926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080355926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:56.874943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10930): Terminating (SIGTERM) 08:03:56.914442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10933): Terminating (SIGTERM) 08:03:56.953882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10936): Terminating (SIGTERM) 08:03:56.993583 --- ParallelTerminationStrategy: PID 10930 died... 08:03:57.012469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10930): Terminated: ok {rc=0} 08:03:57.057244 --- ParallelTerminationStrategy: PID 10933 died... 08:03:57.075846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10933): Terminated: ok {rc=0} 08:03:57.119790 --- ParallelTerminationStrategy: PID 10936 died... 08:03:57.138385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10936): Terminated: ok {rc=0} 08:03:57.224307 bus /sierra_3: Setting Powered False 08:03:58.323557 bus /sierra_3: Setting Powered False 08:03:59.436470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:04:00.584766 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:04:00.597610 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:04:00.667746 tst mo_mt_call_osmux.py: using LAC 20074 08:04:00.787963 tst mo_mt_call_osmux.py: using RAC 184 08:04:00.930396 tst mo_mt_call_osmux.py: using CellId 20074 08:04:01.059819 tst mo_mt_call_osmux.py: using BVCI 20075 08:04:01.200932 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:04:01.214119 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:04:01.226822 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:04:01.240440 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:04:01.254370 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:04:01.267829 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:04:01.392263 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:04:01.519844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:02.046199 run create_hlr_db(pid=10939): Launched 08:04:02.214810 bus /sierra_2: Setting Powered False 08:04:03.278934 run create_hlr_db(pid=10939): Terminated: ok {rc=0} 08:04:03.733769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10941): Launched 08:04:04.061577 run osmo-hlr_10.42.42.2(pid=10942): Launched 08:04:04.185636 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:04.745037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10944): Launched 08:04:05.072402 run osmo-stp_10.42.42.5(pid=10945): Launched 08:04:05.195339 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:05.785615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10947): Launched 08:04:06.111865 run osmo-msc_10.42.42.6(pid=10948): Launched 08:04:06.293219 run osmo-stp_10.42.42.5(pid=10945): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10945)] 08:04:06.429926 run osmo-stp_10.42.42.5(pid=10945): stdout: | (launched: 2022-12-09_08:04:05.012609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:06.566841 run osmo-stp_10.42.42.5(pid=10945): stderr: | 20221209080405204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080405204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080405204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080405205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080405205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080405205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080405205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:06.703509 run osmo-stp_10.42.42.5(pid=10945): stdout: | (launched: 2022-12-09_08:04:05.012609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:06.833763 run osmo-stp_10.42.42.5(pid=10945): stderr: | 20221209080405204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080405204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080405204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080405205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080405205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080405205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080405205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:06.989251 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10945): Process ended prematurely: osmo-stp_10.42.42.5(pid=10945) [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10945)] [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:04:06.998913 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:04:07.026993 run osmo-hlr_10.42.42.2(pid=10942): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10942)] 08:04:07.076938 run osmo-hlr_10.42.42.2(pid=10942): stdout: | (launched: 2022-12-09_08:04:04.001348) 08:04:07.128706 run osmo-hlr_10.42.42.2(pid=10942): stderr: | 20221209080404198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080404198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080404198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080404198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080404198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080404198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080404211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080404219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080404220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080404220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:07.200717 run osmo-msc_10.42.42.6(pid=10948): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10948)] 08:04:07.250479 run osmo-msc_10.42.42.6(pid=10948): stdout: | (launched: 2022-12-09_08:04:06.051577) 08:04:07.301645 run osmo-msc_10.42.42.6(pid=10948): stderr: | 20221209080406372 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080406372 DLGLOBAL DEBUG validating counter group 0x7f10be7e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080406372 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080406372 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080406373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080406373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080406375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080406375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080406375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080406375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:07.353407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10941): Terminating (SIGTERM) 08:04:07.394831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10944): Terminating (SIGTERM) 08:04:07.436439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10947): Terminating (SIGTERM) 08:04:07.478406 --- ParallelTerminationStrategy: PID 10941 died... 08:04:07.498070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10941): Terminated: ok {rc=0} 08:04:07.544038 --- ParallelTerminationStrategy: PID 10944 died... 08:04:07.563660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10944): Terminated: ok {rc=0} 08:04:07.609718 --- ParallelTerminationStrategy: PID 10947 died... 08:04:07.629305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10947): Terminated: ok {rc=0} 08:04:07.716879 bus /sierra_3: Setting Powered False 08:04:08.816483 bus /sierra_3: Setting Powered False 08:04:09.934037 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:04:11.184512 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:11.191467 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:04:11.223609 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:04:11.252317 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:04:11.304485 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:04:11.336665 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:04:11.363653 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:04:11.921466 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:04:11.977144 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:11.988672 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:04:12.039085 tst mo_mt_call.py: using LAC 20075 08:04:12.159879 tst mo_mt_call.py: using RAC 185 08:04:12.281456 tst mo_mt_call.py: using CellId 20075 08:04:12.402387 tst mo_mt_call.py: using BVCI 20076 08:04:12.514780 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:12.526558 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:12.537907 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:12.549228 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:12.560554 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:12.571797 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:04:12.689318 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:04:12.810908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:13.318646 run create_hlr_db(pid=10955): Launched 08:04:13.452787 bus /sierra_2: Setting Powered False 08:04:14.518029 run create_hlr_db(pid=10955): Terminated: ok {rc=0} 08:04:14.954169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10957): Launched 08:04:15.258752 run osmo-hlr_10.42.42.2(pid=10958): Launched 08:04:15.375307 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:15.949706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10960): Launched 08:04:16.301542 run osmo-stp_10.42.42.5(pid=10961): Launched 08:04:16.508016 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:17.225631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10963): Launched 08:04:17.562632 run osmo-msc_10.42.42.6(pid=10964): Launched 08:04:17.748188 run osmo-stp_10.42.42.5(pid=10961): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10961)] 08:04:17.887755 run osmo-stp_10.42.42.5(pid=10961): stdout: | (launched: 2022-12-09_08:04:16.236644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:18.025505 run osmo-stp_10.42.42.5(pid=10961): stderr: | 20221209080416541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080416541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080416541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080416543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080416544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080416544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080416544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:18.161889 run osmo-stp_10.42.42.5(pid=10961): stdout: | (launched: 2022-12-09_08:04:16.236644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:18.292001 run osmo-stp_10.42.42.5(pid=10961): stderr: | 20221209080416541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080416541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080416541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080416543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080416544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080416544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080416544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:18.447883 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10961): Process ended prematurely: osmo-stp_10.42.42.5(pid=10961) [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10961)] [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:04:18.457479 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:04:18.485068 run osmo-hlr_10.42.42.2(pid=10958): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10958)] 08:04:18.534353 run osmo-hlr_10.42.42.2(pid=10958): stdout: | (launched: 2022-12-09_08:04:15.202471) 08:04:18.585280 run osmo-hlr_10.42.42.2(pid=10958): stderr: | 20221209080415378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080415378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080415378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080415378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080415378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080415378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080415390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080415399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080415399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080415399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:18.656432 run osmo-msc_10.42.42.6(pid=10964): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10964)] 08:04:18.705606 run osmo-msc_10.42.42.6(pid=10964): stdout: | (launched: 2022-12-09_08:04:17.502887) 08:04:18.756132 run osmo-msc_10.42.42.6(pid=10964): stderr: | 20221209080417822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080417822 DLGLOBAL DEBUG validating counter group 0x7ffa0b2bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080417823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080417823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080417823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080417823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080417825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080417825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080417825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080417825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:18.807097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10957): Terminating (SIGTERM) 08:04:18.847952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10960): Terminating (SIGTERM) 08:04:18.891224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10963): Terminating (SIGTERM) 08:04:18.932454 --- ParallelTerminationStrategy: PID 10957 died... 08:04:18.951981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10957): Terminated: ok {rc=0} 08:04:18.997821 --- ParallelTerminationStrategy: PID 10960 died... 08:04:19.017076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10960): Terminated: ok {rc=0} 08:04:19.062595 --- ParallelTerminationStrategy: PID 10963 died... 08:04:19.082056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10963): Terminated: ok {rc=0} 08:04:19.169058 bus /sierra_3: Setting Powered False 08:04:20.266599 bus /sierra_3: Setting Powered False 08:04:21.380290 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:04:22.528610 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:22.541410 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:04:22.593788 tst mo_mt_call_osmux.py: using LAC 20076 08:04:22.723456 tst mo_mt_call_osmux.py: using RAC 186 08:04:22.850421 tst mo_mt_call_osmux.py: using CellId 20076 08:04:22.981993 tst mo_mt_call_osmux.py: using BVCI 20077 08:04:23.101751 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:23.113803 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:23.125565 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:23.137400 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:23.149296 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:04:23.161056 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:04:23.279058 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:04:23.400523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:23.909038 run create_hlr_db(pid=10966): Launched 08:04:24.030228 bus /sierra_2: Setting Powered False 08:04:25.091289 run create_hlr_db(pid=10966): Terminated: ok {rc=0} 08:04:25.538035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10968): Launched 08:04:25.866412 run osmo-hlr_10.42.42.2(pid=10969): Launched 08:04:25.992127 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:26.553704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10971): Launched 08:04:26.881866 run osmo-stp_10.42.42.5(pid=10972): Launched 08:04:27.005914 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:27.595711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10974): Launched 08:04:27.924436 run osmo-msc_10.42.42.6(pid=10975): Launched 08:04:28.107670 run osmo-stp_10.42.42.5(pid=10972): ERR: Terminated: ERROR {rc=1} [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10972)] 08:04:28.244292 run osmo-stp_10.42.42.5(pid=10972): stdout: | (launched: 2022-12-09_08:04:26.821418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:28.381731 run osmo-stp_10.42.42.5(pid=10972): stderr: | 20221209080427012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080427012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080427012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080427013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080427013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080427013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080427013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:28.518283 run osmo-stp_10.42.42.5(pid=10972): stdout: | (launched: 2022-12-09_08:04:26.821418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:28.648504 run osmo-stp_10.42.42.5(pid=10972): stderr: | 20221209080427012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080427012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080427012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080427013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080427013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080427013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080427013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:28.804940 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10972): Process ended prematurely: osmo-stp_10.42.42.5(pid=10972) [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10972)] [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:04:28.814639 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:04:28.842604 run osmo-hlr_10.42.42.2(pid=10969): ERR: Terminated: ERROR {rc=237} [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10969)] 08:04:28.891998 run osmo-hlr_10.42.42.2(pid=10969): stdout: | (launched: 2022-12-09_08:04:25.806918) 08:04:28.943068 run osmo-hlr_10.42.42.2(pid=10969): stderr: | 20221209080426003 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080426003 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080426003 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080426003 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080426003 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080426003 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080426015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080426024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080426024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080426024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:29.014410 run osmo-msc_10.42.42.6(pid=10975): ERR: Terminated: ERROR {rc=2} [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10975)] 08:04:29.063744 run osmo-msc_10.42.42.6(pid=10975): stdout: | (launched: 2022-12-09_08:04:27.864432) 08:04:29.115055 run osmo-msc_10.42.42.6(pid=10975): stderr: | 20221209080428186 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080428186 DLGLOBAL DEBUG validating counter group 0x7f694b799c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080428187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080428187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080428187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080428187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080428189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080428189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080428189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080428189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:29.166521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10968): Terminating (SIGTERM) 08:04:29.207870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10971): Terminating (SIGTERM) 08:04:29.249239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10974): Terminating (SIGTERM) 08:04:29.291014 --- ParallelTerminationStrategy: PID 10968 died... 08:04:29.310882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10968): Terminated: ok {rc=0} 08:04:29.357453 --- ParallelTerminationStrategy: PID 10971 died... 08:04:29.376838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10971): Terminated: ok {rc=0} 08:04:29.423322 --- ParallelTerminationStrategy: PID 10974 died... 08:04:29.442977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10974): Terminated: ok {rc=0} 08:04:29.530575 bus /sierra_3: Setting Powered False 08:04:30.626040 bus /sierra_3: Setting Powered False 08:04:31.739969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 emergency:nanobts+band-900 --------------------------------------------------------------------- 08:04:33.003395 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:33.009043 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:04:33.042423 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:04:33.070358 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 08:04:33.157256 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:04:33.190434 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:04:33.218092 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 08:04:33.809609 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2356 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 08:04:33.816276 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:33.829102 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:33.881177 tst emergency_mo_mt_call.py: using LAC 20077 08:04:33.998956 tst emergency_mo_mt_call.py: using RAC 187 08:04:34.115472 tst emergency_mo_mt_call.py: using CellId 20077 08:04:34.237211 tst emergency_mo_mt_call.py: using BVCI 20078 08:04:34.348007 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:34.359231 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:34.370176 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:34.381375 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:34.392579 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:34.403911 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:34.524244 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:34.643651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:35.142511 run create_hlr_db(pid=10980): Launched 08:04:35.274768 bus /sierra_2: Setting Powered False 08:04:36.338374 run create_hlr_db(pid=10980): Terminated: ok {rc=0} 08:04:36.768062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Launched 08:04:37.067894 run osmo-hlr_10.42.42.2(pid=10983): Launched 08:04:37.182497 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:37.697684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Launched 08:04:37.997856 run osmo-stp_10.42.42.5(pid=10986): Launched 08:04:38.121768 tst emergency_mo_mt_call.py: using MSISDN 7098 08:04:38.273983 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:38.812757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10988): Launched 08:04:39.112819 run osmo-msc_10.42.42.6(pid=10989): Launched 08:04:39.283002 run osmo-stp_10.42.42.5(pid=10986): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] 08:04:39.410794 run osmo-stp_10.42.42.5(pid=10986): stdout: | (launched: 2022-12-09_08:04:37.942362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:39.538073 run osmo-stp_10.42.42.5(pid=10986): stderr: | 20221209080438108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080438108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080438109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080438109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080438110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080438110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080438110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:39.663574 run osmo-stp_10.42.42.5(pid=10986): stdout: | (launched: 2022-12-09_08:04:37.942362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:39.782924 run osmo-stp_10.42.42.5(pid=10986): stderr: | 20221209080438108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080438108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080438109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080438109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080438110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080438110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080438110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:39.926475 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10986): Process ended prematurely: osmo-stp_10.42.42.5(pid=10986) [trial-2356↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] [trial-2356↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 08:04:39.935007 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 08:04:39.961206 run osmo-hlr_10.42.42.2(pid=10983): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10983)] 08:04:40.009829 run osmo-hlr_10.42.42.2(pid=10983): stdout: | (launched: 2022-12-09_08:04:37.012099) 08:04:40.059772 run osmo-hlr_10.42.42.2(pid=10983): stderr: | 20221209080437184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080437184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080437184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080437185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080437185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080437185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080437209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080437218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080437218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080437218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:40.129219 run osmo-msc_10.42.42.6(pid=10989): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10989)] 08:04:40.177083 run osmo-msc_10.42.42.6(pid=10989): stdout: | (launched: 2022-12-09_08:04:39.057075) 08:04:40.226468 run osmo-msc_10.42.42.6(pid=10989): stderr: | 20221209080439325 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080439325 DLGLOBAL DEBUG validating counter group 0x7fcf70d98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080439325 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080439325 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080439325 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080439326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080439327 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080439328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080439328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080439328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:40.275880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Terminating (SIGTERM) 08:04:40.315364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Terminating (SIGTERM) 08:04:40.355069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10988): Terminating (SIGTERM) 08:04:40.395012 --- ParallelTerminationStrategy: PID 10982 died... 08:04:40.414533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Terminated: ok {rc=0} 08:04:40.459075 --- ParallelTerminationStrategy: PID 10985 died... 08:04:40.477847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Terminated: ok {rc=0} 08:04:40.521976 --- ParallelTerminationStrategy: PID 10988 died... 08:04:40.540394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10988): Terminated: ok {rc=0} 08:04:40.627021 bus /sierra_3: Setting Powered False 08:04:41.726401 bus /sierra_3: Setting Powered False 08:04:42.838456 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 08:04:43.925850 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:43.937867 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:43.988812 tst emergency_preemptive_call.py: using LAC 20078 08:04:44.116799 tst emergency_preemptive_call.py: using RAC 188 08:04:44.243913 tst emergency_preemptive_call.py: using CellId 20078 08:04:44.369920 tst emergency_preemptive_call.py: using BVCI 20079 08:04:44.487888 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:44.499274 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:44.510408 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:44.521671 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:44.533406 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:44.544444 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:44.663896 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:44.785579 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:44.904063 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:45.022117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:45.524709 run create_hlr_db(pid=10992): Launched 08:04:45.654708 bus /sierra_2: Setting Powered False 08:04:46.735164 run create_hlr_db(pid=10992): Terminated: ok {rc=0} 08:04:47.238005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10994): Launched 08:04:47.552478 run osmo-hlr_10.42.42.2(pid=10995): Launched 08:04:47.667993 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:48.195534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10998): Launched 08:04:48.496259 run osmo-stp_10.42.42.5(pid=10999): Launched 08:04:48.620681 tst emergency_preemptive_call.py: using MSISDN 7099 08:04:48.773496 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:49.311438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11001): Launched 08:04:49.611792 run osmo-msc_10.42.42.6(pid=11002): Launched 08:04:49.781501 run osmo-stp_10.42.42.5(pid=10999): ERR: Terminated: ERROR {rc=1} [trial-2356↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10999)] 08:04:49.909421 run osmo-stp_10.42.42.5(pid=10999): stdout: | (launched: 2022-12-09_08:04:48.439934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:50.037429 run osmo-stp_10.42.42.5(pid=10999): stderr: | 20221209080448608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080448608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080448608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080448609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080448609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080448609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080448609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:50.163074 run osmo-stp_10.42.42.5(pid=10999): stdout: | (launched: 2022-12-09_08:04:48.439934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:50.283170 run osmo-stp_10.42.42.5(pid=10999): stderr: | 20221209080448608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080448608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080448608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080448609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080448609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080448609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080448609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:50.426383 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10999): Process ended prematurely: osmo-stp_10.42.42.5(pid=10999) [trial-2356↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10999)] [trial-2356↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 08:04:50.434840 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 08:04:50.461430 run osmo-hlr_10.42.42.2(pid=10995): ERR: Terminated: ERROR {rc=237} [trial-2356↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10995)] 08:04:50.509438 run osmo-hlr_10.42.42.2(pid=10995): stdout: | (launched: 2022-12-09_08:04:47.495768) 08:04:50.559228 run osmo-hlr_10.42.42.2(pid=10995): stderr: | 20221209080447668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080447668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080447668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080447668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080447668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080447668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080447681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080447689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080447689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080447689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:50.629055 run osmo-msc_10.42.42.6(pid=11002): ERR: Terminated: ERROR {rc=2} [trial-2356↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11002)] 08:04:50.677077 run osmo-msc_10.42.42.6(pid=11002): stdout: | (launched: 2022-12-09_08:04:49.555290) 08:04:50.726808 run osmo-msc_10.42.42.6(pid=11002): stderr: | 20221209080449824 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080449824 DLGLOBAL DEBUG validating counter group 0x7fdc97e51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080449824 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080449825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080449825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080449825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080449827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080449827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080449827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080449827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:50.776702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10994): Terminating (SIGTERM) 08:04:50.816451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10998): Terminating (SIGTERM) 08:04:50.856581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11001): Terminating (SIGTERM) 08:04:50.896989 --- ParallelTerminationStrategy: PID 10994 died... 08:04:50.916209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10994): Terminated: ok {rc=0} 08:04:50.960836 --- ParallelTerminationStrategy: PID 10998 died... 08:04:50.979262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10998): Terminated: ok {rc=0} 08:04:51.023434 --- ParallelTerminationStrategy: PID 11001 died... 08:04:51.042179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11001): Terminated: ok {rc=0} 08:04:51.128028 bus /sierra_9: Setting Powered False 08:04:52.227900 bus /sierra_9: Setting Powered False 08:04:53.343771 bus /sierra_8: Setting Powered False 08:04:54.442012 bus /sierra_8: Setting Powered False 08:04:55.556015 bus /sierra_3: Setting Powered False 08:04:56.655393 bus /sierra_3: Setting Powered False 08:04:57.771941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900 --------------------------------------------------------------------- 08:04:59.049598 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:59.054807 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:04:59.088052 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 08:04:59.127039 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 08:04:59.214537 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:04:59.247287 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 08:04:59.286398 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 08:04:59.878837 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 08:04:59.928934 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:59.939874 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:59.992378 tst cs_paging_gprs_active.py: using LAC 20079 08:05:00.112244 tst cs_paging_gprs_active.py: using RAC 189 08:05:00.230678 tst cs_paging_gprs_active.py: using CellId 20079 08:05:00.350360 tst cs_paging_gprs_active.py: using BVCI 20080 08:05:00.470950 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.482551 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.493896 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.505483 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.516752 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.528186 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.539812 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.551238 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:00.562986 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:00.681285 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:00.802419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:05:01.030498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:01.346334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11007): Launched 08:05:01.639999 run iperf3-srv_10.42.42.10(pid=11009): Launched 08:05:01.780605 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:05:01.990557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:02.304842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Launched 08:05:02.572687 run iperf3-srv_10.42.42.10(pid=11013): Launched 08:05:02.687667 tst cs_paging_gprs_active.py:38: start network... 08:05:02.892201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:03.365252 run create_hlr_db(pid=11014): Launched 08:05:03.491741 bus /sierra_2: Setting Powered False 08:05:04.556264 run create_hlr_db(pid=11014): Terminated: ok {rc=0} 08:05:05.012137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Launched 08:05:05.339021 run osmo-hlr_10.42.42.2(pid=11035): Launched 08:05:05.464810 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:06.034493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Launched 08:05:06.363213 run osmo-stp_10.42.42.5(pid=11039): Launched 08:05:06.488877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:07.052118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Launched 08:05:07.178836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:07.456395 run patchelf(pid=11042): Launched 08:05:07.637987 run osmo-stp_10.42.42.5(pid=11039): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] 08:05:07.776628 run osmo-stp_10.42.42.5(pid=11039): stdout: | (launched: 2022-12-09_08:05:06.303205) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:07.916246 run osmo-stp_10.42.42.5(pid=11039): stderr: | 20221209080506495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080506495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080506495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080506496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080506496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080506496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080506496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:08.056040 run osmo-stp_10.42.42.5(pid=11039): stdout: | (launched: 2022-12-09_08:05:06.303205) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:08.191030 run osmo-stp_10.42.42.5(pid=11039): stderr: | 20221209080506495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080506495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080506495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080506496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080506496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080506496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080506496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:08.350122 run patchelf(pid=11042): Terminating (SIGINT) 08:05:08.532348 run patchelf(pid=11042): Terminated: ok {rc=0} 08:05:08.664240 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11039): Process ended prematurely: osmo-stp_10.42.42.5(pid=11039) [trial-2356↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] [trial-2356↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 08:05:08.675010 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:05:08.704310 run osmo-hlr_10.42.42.2(pid=11035): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11035)] 08:05:08.755441 run osmo-hlr_10.42.42.2(pid=11035): stdout: | (launched: 2022-12-09_08:05:05.279102) 08:05:08.807455 run osmo-hlr_10.42.42.2(pid=11035): stderr: | 20221209080505475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080505475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080505475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080505475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080505475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080505475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080505488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080505496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080505497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080505497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:08.859940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11007): Terminating (SIGTERM) 08:05:08.901571 run iperf3-srv_10.42.42.10(pid=11009): Terminating (SIGTERM) 08:05:08.943310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Terminating (SIGTERM) 08:05:08.985360 run iperf3-srv_10.42.42.10(pid=11013): Terminating (SIGTERM) 08:05:09.027154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Terminating (SIGTERM) 08:05:09.068922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Terminating (SIGTERM) 08:05:09.111189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Terminating (SIGTERM) 08:05:09.153421 --- ParallelTerminationStrategy: PID 11007 died... 08:05:09.173370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11007): Terminated: ok {rc=0} 08:05:09.220226 --- ParallelTerminationStrategy: PID 11009 died... 08:05:09.239765 run iperf3-srv_10.42.42.10(pid=11009): Terminated {rc=256} 08:05:09.286000 --- ParallelTerminationStrategy: PID 11012 died... 08:05:09.305478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Terminated: ok {rc=0} 08:05:09.351777 --- ParallelTerminationStrategy: PID 11013 died... 08:05:09.371158 run iperf3-srv_10.42.42.10(pid=11013): Terminated {rc=256} 08:05:09.417164 --- ParallelTerminationStrategy: PID 11016 died... 08:05:09.436630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Terminated: ok {rc=0} 08:05:09.482865 --- ParallelTerminationStrategy: PID 11038 died... 08:05:09.502267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Terminated: ok {rc=0} 08:05:09.548245 --- ParallelTerminationStrategy: PID 11041 died... 08:05:09.568132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Terminated: ok {rc=0} 08:05:09.655168 bus /gobi_0: Setting Powered False 08:05:10.753411 bus /gobi_0: Setting Powered False 08:05:11.870790 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 08:05:13.015781 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.027640 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:05:13.078426 tst iperf3.py: using LAC 20080 08:05:13.208927 tst iperf3.py: using RAC 190 08:05:13.337641 tst iperf3.py: using CellId 20080 08:05:13.460745 tst iperf3.py: using BVCI 20081 08:05:13.573720 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.584594 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.595294 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.605863 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.616279 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.626859 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.637559 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.647995 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:13.658714 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:13.773285 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:05:13.978732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:14.285125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11043): Launched 08:05:14.550355 run iperf3-srv_10.42.42.10(pid=11045): Launched 08:05:14.666205 tst iperf3.py:8: start network... 08:05:14.871101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:15.345488 run create_hlr_db(pid=11046): Launched 08:05:15.469912 bus /gobi_6: Setting Powered False 08:05:16.530160 run create_hlr_db(pid=11046): Terminated: ok {rc=0} 08:05:16.968078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11048): Launched 08:05:17.338965 run osmo-hlr_10.42.42.2(pid=11049): Launched 08:05:17.468364 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:18.038238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11051): Launched 08:05:18.356840 run osmo-stp_10.42.42.5(pid=11052): Launched 08:05:18.474141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:19.000886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11054): Launched 08:05:19.116589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:19.375995 run patchelf(pid=11055): Launched 08:05:19.546049 run osmo-stp_10.42.42.5(pid=11052): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11052)] 08:05:19.675163 run osmo-stp_10.42.42.5(pid=11052): stdout: | (launched: 2022-12-09_08:05:18.299991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:19.805741 run osmo-stp_10.42.42.5(pid=11052): stderr: | 20221209080518469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080518469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080518469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080518470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080518470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080518470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080518470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:19.936125 run osmo-stp_10.42.42.5(pid=11052): stdout: | (launched: 2022-12-09_08:05:18.299991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:20.061196 run osmo-stp_10.42.42.5(pid=11052): stderr: | 20221209080518469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080518469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080518469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080518470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080518470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080518470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080518470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:20.210171 run patchelf(pid=11055): Terminating (SIGINT) 08:05:20.381091 run patchelf(pid=11055): Terminated: ok {rc=0} 08:05:20.503644 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11052): Process ended prematurely: osmo-stp_10.42.42.5(pid=11052) [trial-2356↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11052)] [trial-2356↪gprs:nanobts+band-900↪iperf3.py:8] 08:05:20.513287 tst iperf3.py:8: Test FAILED (7.5 sec) 08:05:20.540175 run osmo-hlr_10.42.42.2(pid=11049): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11049)] 08:05:20.587136 run osmo-hlr_10.42.42.2(pid=11049): stdout: | (launched: 2022-12-09_08:05:17.278519) 08:05:20.635796 run osmo-hlr_10.42.42.2(pid=11049): stderr: | 20221209080517472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080517472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080517472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080517472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080517472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080517472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080517485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080517493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080517494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080517494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:20.684785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11043): Terminating (SIGTERM) 08:05:20.724022 run iperf3-srv_10.42.42.10(pid=11045): Terminating (SIGTERM) 08:05:20.763105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11048): Terminating (SIGTERM) 08:05:20.802750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11051): Terminating (SIGTERM) 08:05:20.841900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11054): Terminating (SIGTERM) 08:05:20.881330 --- ParallelTerminationStrategy: PID 11043 died... 08:05:20.900161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11043): Terminated: ok {rc=0} 08:05:20.943316 --- ParallelTerminationStrategy: PID 11045 died... 08:05:20.961685 run iperf3-srv_10.42.42.10(pid=11045): Terminated {rc=256} 08:05:21.004818 --- ParallelTerminationStrategy: PID 11048 died... 08:05:21.023646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11048): Terminated: ok {rc=0} 08:05:21.067002 --- ParallelTerminationStrategy: PID 11051 died... 08:05:21.085480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11051): Terminated: ok {rc=0} 08:05:21.128842 --- ParallelTerminationStrategy: PID 11054 died... 08:05:21.147662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11054): Terminated: ok {rc=0} 08:05:21.232125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 08:05:22.379569 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:22.391744 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:05:22.441408 tst iperf3m4.py: using LAC 20081 08:05:22.563029 tst iperf3m4.py: using RAC 191 08:05:22.685920 tst iperf3m4.py: using CellId 20081 08:05:22.816881 tst iperf3m4.py: using BVCI 20082 08:05:22.936577 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:22.947993 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:22.959166 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:22.970401 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:22.981551 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:22.992500 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:23.003753 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:23.014788 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:23.026598 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:23.143136 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:23.262414 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:23.383791 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:23.506060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:05:23.729654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:24.059825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11056): Launched 08:05:24.345785 run iperf3-srv_10.42.42.10(pid=11057): Launched 08:05:24.470131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:05:24.692080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:25.021722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11058): Launched 08:05:25.305943 run iperf3-srv_10.42.42.10(pid=11059): Launched 08:05:25.421589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:05:25.626700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:25.935391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11060): Launched 08:05:26.200094 run iperf3-srv_10.42.42.10(pid=11061): Launched 08:05:26.314617 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:05:26.518513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:26.825675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11062): Launched 08:05:27.090829 run iperf3-srv_10.42.42.10(pid=11063): Launched 08:05:27.204514 tst iperf3m4.py:8: start network... 08:05:27.408558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:27.882777 run create_hlr_db(pid=11064): Launched 08:05:28.007473 bus /gobi_6: Setting Powered False 08:05:29.068765 run create_hlr_db(pid=11064): Terminated: ok {rc=0} 08:05:29.515985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11066): Launched 08:05:29.846352 run osmo-hlr_10.42.42.2(pid=11067): Launched 08:05:29.971624 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:30.539041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11069): Launched 08:05:30.869783 run osmo-stp_10.42.42.5(pid=11070): Launched 08:05:31.091217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:31.685708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11072): Launched 08:05:31.825037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:32.097676 run patchelf(pid=11073): Launched 08:05:32.273878 run osmo-stp_10.42.42.5(pid=11070): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11070)] 08:05:32.404793 run osmo-stp_10.42.42.5(pid=11070): stdout: | (launched: 2022-12-09_08:05:30.807573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:32.536516 run osmo-stp_10.42.42.5(pid=11070): stderr: | 20221209080531160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080531160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080531160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080531161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080531161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080531161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080531161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:32.667527 run osmo-stp_10.42.42.5(pid=11070): stdout: | (launched: 2022-12-09_08:05:30.807573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:32.793614 run osmo-stp_10.42.42.5(pid=11070): stderr: | 20221209080531160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080531160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080531160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080531161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080531161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080531161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080531161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:32.942377 run patchelf(pid=11073): Terminating (SIGINT) 08:05:33.113113 run patchelf(pid=11073): Terminated: ok {rc=0} 08:05:33.235499 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11070): Process ended prematurely: osmo-stp_10.42.42.5(pid=11070) [trial-2356↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11070)] [trial-2356↪gprs:nanobts+band-900↪iperf3m4.py:8] 08:05:33.245395 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:05:33.272824 run osmo-hlr_10.42.42.2(pid=11067): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11067)] 08:05:33.320788 run osmo-hlr_10.42.42.2(pid=11067): stdout: | (launched: 2022-12-09_08:05:29.786163) 08:05:33.370554 run osmo-hlr_10.42.42.2(pid=11067): stderr: | 20221209080529982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080529982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080529983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080529983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080529983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080529983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080529995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080530006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080530006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080530006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:33.420394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11056): Terminating (SIGTERM) 08:05:33.460198 run iperf3-srv_10.42.42.10(pid=11057): Terminating (SIGTERM) 08:05:33.500037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11058): Terminating (SIGTERM) 08:05:33.540071 run iperf3-srv_10.42.42.10(pid=11059): Terminating (SIGTERM) 08:05:33.579773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11060): Terminating (SIGTERM) 08:05:33.619574 run iperf3-srv_10.42.42.10(pid=11061): Terminating (SIGTERM) 08:05:33.659291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11062): Terminating (SIGTERM) 08:05:33.699035 run iperf3-srv_10.42.42.10(pid=11063): Terminating (SIGTERM) 08:05:33.738693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11066): Terminating (SIGTERM) 08:05:33.778383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11069): Terminating (SIGTERM) 08:05:33.818104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11072): Terminating (SIGTERM) 08:05:33.858122 --- ParallelTerminationStrategy: PID 11056 died... 08:05:33.877199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11056): Terminated: ok {rc=0} 08:05:33.921536 --- ParallelTerminationStrategy: PID 11057 died... 08:05:33.940395 run iperf3-srv_10.42.42.10(pid=11057): Terminated {rc=256} 08:05:33.984135 --- ParallelTerminationStrategy: PID 11058 died... 08:05:34.003147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11058): Terminated: ok {rc=0} 08:05:34.047283 --- ParallelTerminationStrategy: PID 11059 died... 08:05:34.066142 run iperf3-srv_10.42.42.10(pid=11059): Terminated {rc=256} 08:05:34.110321 --- ParallelTerminationStrategy: PID 11060 died... 08:05:34.129233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11060): Terminated: ok {rc=0} 08:05:34.173338 --- ParallelTerminationStrategy: PID 11061 died... 08:05:34.192232 run iperf3-srv_10.42.42.10(pid=11061): Terminated {rc=256} 08:05:34.236099 --- ParallelTerminationStrategy: PID 11062 died... 08:05:34.254980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11062): Terminated: ok {rc=0} 08:05:34.299262 --- ParallelTerminationStrategy: PID 11063 died... 08:05:34.318199 run iperf3-srv_10.42.42.10(pid=11063): Terminated {rc=256} 08:05:34.362063 --- ParallelTerminationStrategy: PID 11066 died... 08:05:34.381058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11066): Terminated: ok {rc=0} 08:05:34.424829 --- ParallelTerminationStrategy: PID 11069 died... 08:05:34.444072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11069): Terminated: ok {rc=0} 08:05:34.488238 --- ParallelTerminationStrategy: PID 11072 died... 08:05:34.507249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11072): Terminated: ok {rc=0} 08:05:34.593779 bus /gobi_4: Setting Powered False 08:05:35.694206 bus /gobi_4: Setting Powered False 08:05:36.809679 bus /gobi_1: Setting Powered False 08:05:37.908297 bus /gobi_1: Setting Powered False 08:05:39.023945 bus /gobi_0: Setting Powered False 08:05:40.123345 bus /gobi_0: Setting Powered False 08:05:41.240437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900 ping.py ---------------------------------------------- 08:05:42.342310 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.354352 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:05:42.404855 tst ping.py: using LAC 20082 08:05:42.532539 tst ping.py: using RAC 192 08:05:42.659178 tst ping.py: using CellId 20082 08:05:42.786074 tst ping.py: using BVCI 20083 08:05:42.902774 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.914144 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.925281 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.936501 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.947565 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.958536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.969682 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:42.980758 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:43.100267 tst ping.py:19: start network... 08:05:43.319602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:43.819104 run create_hlr_db(pid=11074): Launched 08:05:43.941707 bus /gobi_6: Setting Powered False 08:05:45.005124 run create_hlr_db(pid=11074): Terminated: ok {rc=0} 08:05:45.432296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11076): Launched 08:05:45.731851 run osmo-hlr_10.42.42.2(pid=11077): Launched 08:05:45.846751 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:46.559551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11079): Launched 08:05:46.906840 run osmo-stp_10.42.42.5(pid=11080): Launched 08:05:47.183769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:47.743242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11082): Launched 08:05:47.867057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:48.139920 run patchelf(pid=11083): Launched 08:05:48.320045 run osmo-stp_10.42.42.5(pid=11080): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11080)] 08:05:48.456840 run osmo-stp_10.42.42.5(pid=11080): stdout: | (launched: 2022-12-09_08:05:46.842763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:48.595148 run osmo-stp_10.42.42.5(pid=11080): stderr: | 20221209080547046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080547046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080547046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080547047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080547047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080547047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080547048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:48.733660 run osmo-stp_10.42.42.5(pid=11080): stdout: | (launched: 2022-12-09_08:05:46.842763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:48.866296 run osmo-stp_10.42.42.5(pid=11080): stderr: | 20221209080547046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080547046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080547046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080547047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080547047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080547047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080547048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:49.023099 run patchelf(pid=11083): Terminating (SIGINT) 08:05:49.202925 run patchelf(pid=11083): Terminated: ok {rc=0} 08:05:49.332135 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11080): Process ended prematurely: osmo-stp_10.42.42.5(pid=11080) [trial-2356↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11080)] [trial-2356↪gprs:nanobts+band-900↪ping.py:22] 08:05:49.342003 tst ping.py:22: Test FAILED (7.0 sec) 08:05:49.370306 run osmo-hlr_10.42.42.2(pid=11077): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11077)] 08:05:49.420754 run osmo-hlr_10.42.42.2(pid=11077): stdout: | (launched: 2022-12-09_08:05:45.675408) 08:05:49.473465 run osmo-hlr_10.42.42.2(pid=11077): stderr: | 20221209080545889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080545889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080545890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080545890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080545890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080545890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080545911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080545928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080545928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080545928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:49.525942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11076): Terminating (SIGTERM) 08:05:49.568360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11079): Terminating (SIGTERM) 08:05:49.611059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11082): Terminating (SIGTERM) 08:05:49.653849 --- ParallelTerminationStrategy: PID 11076 died... 08:05:49.674617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11076): Terminated: ok {rc=0} 08:05:49.721654 --- ParallelTerminationStrategy: PID 11079 died... 08:05:49.741526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11079): Terminated: ok {rc=0} 08:05:49.788205 --- ParallelTerminationStrategy: PID 11082 died... 08:05:49.808021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11082): Terminated: ok {rc=0} 08:05:49.896534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 08:05:50.984416 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:50.997302 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:05:51.049462 tst ping_idle_ping.py: using LAC 20083 08:05:51.176710 tst ping_idle_ping.py: using RAC 193 08:05:51.305100 tst ping_idle_ping.py: using CellId 20083 08:05:51.430257 tst ping_idle_ping.py: using BVCI 20084 08:05:51.550346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.561747 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.572919 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.584471 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.595582 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.606699 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.617960 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:05:51.629490 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:05:51.745885 tst ping_idle_ping.py:24: start network... 08:05:51.948829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:52.420108 run create_hlr_db(pid=11084): Launched 08:05:52.544785 bus /gobi_6: Setting Powered False 08:05:53.604524 run create_hlr_db(pid=11084): Terminated: ok {rc=0} 08:05:54.025332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11086): Launched 08:05:54.326790 run osmo-hlr_10.42.42.2(pid=11087): Launched 08:05:54.441464 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:54.960315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11089): Launched 08:05:55.262378 run osmo-stp_10.42.42.5(pid=11090): Launched 08:05:55.378061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:55.897172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11092): Launched 08:05:56.011240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:56.265740 run patchelf(pid=11093): Launched 08:05:56.433112 run osmo-stp_10.42.42.5(pid=11090): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11090)] 08:05:56.560934 run osmo-stp_10.42.42.5(pid=11090): stdout: | (launched: 2022-12-09_08:05:55.206369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:56.689668 run osmo-stp_10.42.42.5(pid=11090): stderr: | 20221209080555371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080555371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080555371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080555372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080555373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080555373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080555373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:56.818430 run osmo-stp_10.42.42.5(pid=11090): stdout: | (launched: 2022-12-09_08:05:55.206369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:56.941393 run osmo-stp_10.42.42.5(pid=11090): stderr: | 20221209080555371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080555371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080555371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080555372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080555373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080555373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080555373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:57.087416 run patchelf(pid=11093): Terminating (SIGINT) 08:05:57.255009 run patchelf(pid=11093): Terminated: ok {rc=0} 08:05:57.375503 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11090): Process ended prematurely: osmo-stp_10.42.42.5(pid=11090) [trial-2356↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11090)] [trial-2356↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 08:05:57.384335 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:05:57.411165 run osmo-hlr_10.42.42.2(pid=11087): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11087)] 08:05:57.458525 run osmo-hlr_10.42.42.2(pid=11087): stdout: | (launched: 2022-12-09_08:05:54.270254) 08:05:57.507698 run osmo-hlr_10.42.42.2(pid=11087): stderr: | 20221209080554443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080554443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080554443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080554443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080554443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080554443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080554455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080554464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080554464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080554464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:57.557285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11086): Terminating (SIGTERM) 08:05:57.597107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11089): Terminating (SIGTERM) 08:05:57.636696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11092): Terminating (SIGTERM) 08:05:57.676892 --- ParallelTerminationStrategy: PID 11086 died... 08:05:57.695876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11086): Terminated: ok {rc=0} 08:05:57.740021 --- ParallelTerminationStrategy: PID 11089 died... 08:05:57.758897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11089): Terminated: ok {rc=0} 08:05:57.802722 --- ParallelTerminationStrategy: PID 11092 died... 08:05:57.821540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11092): Terminated: ok {rc=0} 08:05:57.905228 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 08:05:59.202956 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:05:59.209158 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:05:59.241509 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:05:59.280420 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:05:59.368294 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:05:59.400700 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:05:59.439817 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:06:00.041308 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:06:00.090285 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.101518 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:06:00.150803 tst cs_paging_gprs_active.py: using LAC 20084 08:06:00.273785 tst cs_paging_gprs_active.py: using RAC 194 08:06:00.404062 tst cs_paging_gprs_active.py: using CellId 20084 08:06:00.533433 tst cs_paging_gprs_active.py: using BVCI 20085 08:06:00.647076 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.658425 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.669258 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.680169 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.691092 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.702094 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.713154 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.723827 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:00.734766 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:00.857765 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:00.993035 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:06:01.224875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:01.565918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11097): Launched 08:06:01.857710 run iperf3-srv_10.42.42.10(pid=11098): Launched 08:06:01.988177 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:06:02.199615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:02.511613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11099): Launched 08:06:02.780584 run iperf3-srv_10.42.42.10(pid=11100): Launched 08:06:02.895463 tst cs_paging_gprs_active.py:38: start network... 08:06:03.100687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:03.577105 run create_hlr_db(pid=11101): Launched 08:06:03.701856 bus /gobi_6: Setting Powered False 08:06:04.763133 run create_hlr_db(pid=11101): Terminated: ok {rc=0} 08:06:05.190881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11103): Launched 08:06:05.498730 run osmo-hlr_10.42.42.2(pid=11104): Launched 08:06:05.615057 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:06.147359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11106): Launched 08:06:06.456055 run osmo-stp_10.42.42.5(pid=11107): Launched 08:06:06.573553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:07.102562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11109): Launched 08:06:07.219196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:07.478795 run patchelf(pid=11110): Launched 08:06:07.648123 run osmo-stp_10.42.42.5(pid=11107): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11107)] 08:06:07.777553 run osmo-stp_10.42.42.5(pid=11107): stdout: | (launched: 2022-12-09_08:06:06.398935) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:07.908500 run osmo-stp_10.42.42.5(pid=11107): stderr: | 20221209080606566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080606566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080606566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080606567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080606567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080606567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080606567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:08.039451 run osmo-stp_10.42.42.5(pid=11107): stdout: | (launched: 2022-12-09_08:06:06.398935) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:08.165312 run osmo-stp_10.42.42.5(pid=11107): stderr: | 20221209080606566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080606566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080606566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080606567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080606567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080606567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080606567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:08.313916 run patchelf(pid=11110): Terminating (SIGINT) 08:06:08.484105 run patchelf(pid=11110): Terminated: ok {rc=0} 08:06:08.607982 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11107): Process ended prematurely: osmo-stp_10.42.42.5(pid=11107) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11107)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:06:08.617720 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:06:08.644559 run osmo-hlr_10.42.42.2(pid=11104): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11104)] 08:06:08.691853 run osmo-hlr_10.42.42.2(pid=11104): stdout: | (launched: 2022-12-09_08:06:05.442047) 08:06:08.740697 run osmo-hlr_10.42.42.2(pid=11104): stderr: | 20221209080605618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080605618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080605618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080605618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080605618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080605618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080605630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080605639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080605639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080605639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:08.789907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11097): Terminating (SIGTERM) 08:06:08.829928 run iperf3-srv_10.42.42.10(pid=11098): Terminating (SIGTERM) 08:06:08.869200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11099): Terminating (SIGTERM) 08:06:08.908196 run iperf3-srv_10.42.42.10(pid=11100): Terminating (SIGTERM) 08:06:08.947339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11103): Terminating (SIGTERM) 08:06:08.986728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11106): Terminating (SIGTERM) 08:06:09.026098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11109): Terminating (SIGTERM) 08:06:09.065648 --- ParallelTerminationStrategy: PID 11097 died... 08:06:09.084733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11097): Terminated: ok {rc=0} 08:06:09.128379 --- ParallelTerminationStrategy: PID 11098 died... 08:06:09.146986 run iperf3-srv_10.42.42.10(pid=11098): Terminated {rc=256} 08:06:09.190317 --- ParallelTerminationStrategy: PID 11099 died... 08:06:09.208883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11099): Terminated: ok {rc=0} 08:06:09.252272 --- ParallelTerminationStrategy: PID 11100 died... 08:06:09.270923 run iperf3-srv_10.42.42.10(pid=11100): Terminated {rc=256} 08:06:09.314373 --- ParallelTerminationStrategy: PID 11103 died... 08:06:09.332868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11103): Terminated: ok {rc=0} 08:06:09.376627 --- ParallelTerminationStrategy: PID 11106 died... 08:06:09.395367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11106): Terminated: ok {rc=0} 08:06:09.439009 --- ParallelTerminationStrategy: PID 11109 died... 08:06:09.457594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11109): Terminated: ok {rc=0} 08:06:09.540662 bus /gobi_0: Setting Powered False 08:06:10.638024 bus /gobi_0: Setting Powered False 08:06:11.754110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:06:12.903008 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:12.915241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:06:12.968531 tst iperf3.py: using LAC 20085 08:06:13.096431 tst iperf3.py: using RAC 195 08:06:13.226334 tst iperf3.py: using CellId 20085 08:06:13.360607 tst iperf3.py: using BVCI 20086 08:06:13.481995 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.493650 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.505377 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.516523 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.528037 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.539213 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.550830 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.562107 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:13.573542 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:13.694151 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:06:13.920744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:14.250854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11111): Launched 08:06:14.536281 run iperf3-srv_10.42.42.10(pid=11112): Launched 08:06:14.661204 tst iperf3.py:8: start network... 08:06:14.883711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:15.394027 run create_hlr_db(pid=11113): Launched 08:06:15.519554 bus /gobi_6: Setting Powered False 08:06:16.588588 run create_hlr_db(pid=11113): Terminated: ok {rc=0} 08:06:17.069978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Launched 08:06:17.411288 run osmo-hlr_10.42.42.2(pid=11116): Launched 08:06:17.536664 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:18.106544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Launched 08:06:18.436594 run osmo-stp_10.42.42.5(pid=11119): Launched 08:06:18.560341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:19.127701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11121): Launched 08:06:19.252207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:19.530276 run patchelf(pid=11122): Launched 08:06:19.713058 run osmo-stp_10.42.42.5(pid=11119): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] 08:06:19.851436 run osmo-stp_10.42.42.5(pid=11119): stdout: | (launched: 2022-12-09_08:06:18.375716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:19.991258 run osmo-stp_10.42.42.5(pid=11119): stderr: | 20221209080618565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080618565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080618565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080618566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080618566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080618566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080618566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:20.131169 run osmo-stp_10.42.42.5(pid=11119): stdout: | (launched: 2022-12-09_08:06:18.375716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:20.265610 run osmo-stp_10.42.42.5(pid=11119): stderr: | 20221209080618565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080618565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080618565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080618566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080618566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080618566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080618566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:20.424212 run patchelf(pid=11122): Terminating (SIGINT) 08:06:20.607117 run patchelf(pid=11122): Terminated: ok {rc=0} 08:06:20.739660 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11119): Process ended prematurely: osmo-stp_10.42.42.5(pid=11119) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 08:06:20.749931 tst iperf3.py:8: Test FAILED (7.9 sec) 08:06:20.778794 run osmo-hlr_10.42.42.2(pid=11116): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11116)] 08:06:20.828620 run osmo-hlr_10.42.42.2(pid=11116): stdout: | (launched: 2022-12-09_08:06:17.350673) 08:06:20.880506 run osmo-hlr_10.42.42.2(pid=11116): stderr: | 20221209080617545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080617545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080617545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080617545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080617545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080617545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080617558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080617568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080617569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080617569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:20.931994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11111): Terminating (SIGTERM) 08:06:20.974251 run iperf3-srv_10.42.42.10(pid=11112): Terminating (SIGTERM) 08:06:21.015917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Terminating (SIGTERM) 08:06:21.057547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Terminating (SIGTERM) 08:06:21.098601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11121): Terminating (SIGTERM) 08:06:21.140371 --- ParallelTerminationStrategy: PID 11111 died... 08:06:21.160252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11111): Terminated: ok {rc=0} 08:06:21.206539 --- ParallelTerminationStrategy: PID 11112 died... 08:06:21.226470 run iperf3-srv_10.42.42.10(pid=11112): Terminated {rc=256} 08:06:21.272477 --- ParallelTerminationStrategy: PID 11115 died... 08:06:21.292109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Terminated: ok {rc=0} 08:06:21.338335 --- ParallelTerminationStrategy: PID 11118 died... 08:06:21.358251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Terminated: ok {rc=0} 08:06:21.404761 --- ParallelTerminationStrategy: PID 11121 died... 08:06:21.424350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11121): Terminated: ok {rc=0} 08:06:21.512370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:06:22.657962 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:22.670078 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:06:22.719695 tst iperf3m4.py: using LAC 20086 08:06:22.840627 tst iperf3m4.py: using RAC 196 08:06:22.964614 tst iperf3m4.py: using CellId 20086 08:06:23.084414 tst iperf3m4.py: using BVCI 20087 08:06:23.194610 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.205918 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.216727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.227582 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.238313 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.249029 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.259948 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.270627 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:23.281623 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:23.398740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:23.523790 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:23.647965 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:23.767128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:06:23.973451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:24.281159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11123): Launched 08:06:24.547202 run iperf3-srv_10.42.42.10(pid=11124): Launched 08:06:24.661939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:06:24.867779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:25.175631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11125): Launched 08:06:25.442397 run iperf3-srv_10.42.42.10(pid=11126): Launched 08:06:25.558309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:06:25.763440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:26.071033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11127): Launched 08:06:26.337789 run iperf3-srv_10.42.42.10(pid=11128): Launched 08:06:26.452167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:06:26.657463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:26.966080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11129): Launched 08:06:27.233577 run iperf3-srv_10.42.42.10(pid=11130): Launched 08:06:27.347561 tst iperf3m4.py:8: start network... 08:06:27.552548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:28.026768 run create_hlr_db(pid=11131): Launched 08:06:28.153356 bus /gobi_6: Setting Powered False 08:06:29.215064 run create_hlr_db(pid=11131): Terminated: ok {rc=0} 08:06:29.642639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11133): Launched 08:06:29.951490 run osmo-hlr_10.42.42.2(pid=11134): Launched 08:06:30.066717 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:30.610551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11136): Launched 08:06:30.948777 run osmo-stp_10.42.42.5(pid=11137): Launched 08:06:31.182098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:31.805797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11139): Launched 08:06:31.938454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:32.228468 run patchelf(pid=11140): Launched 08:06:32.397740 run osmo-stp_10.42.42.5(pid=11137): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11137)] 08:06:32.526535 run osmo-stp_10.42.42.5(pid=11137): stdout: | (launched: 2022-12-09_08:06:30.885351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:32.656526 run osmo-stp_10.42.42.5(pid=11137): stderr: | 20221209080631229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080631229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080631229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080631229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080631237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080631238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080631238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:32.787544 run osmo-stp_10.42.42.5(pid=11137): stdout: | (launched: 2022-12-09_08:06:30.885351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:32.912318 run osmo-stp_10.42.42.5(pid=11137): stderr: | 20221209080631229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080631229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080631229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080631229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080631237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080631238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080631238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:33.059776 run patchelf(pid=11140): Terminating (SIGINT) 08:06:33.229738 run patchelf(pid=11140): Terminated: ok {rc=0} 08:06:33.352363 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11137): Process ended prematurely: osmo-stp_10.42.42.5(pid=11137) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11137)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 08:06:33.361913 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:06:33.389493 run osmo-hlr_10.42.42.2(pid=11134): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11134)] 08:06:33.437169 run osmo-hlr_10.42.42.2(pid=11134): stdout: | (launched: 2022-12-09_08:06:29.893770) 08:06:33.486296 run osmo-hlr_10.42.42.2(pid=11134): stderr: | 20221209080630068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080630068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080630068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080630068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080630068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080630068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080630080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080630088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080630088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080630088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:33.536119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11123): Terminating (SIGTERM) 08:06:33.575443 run iperf3-srv_10.42.42.10(pid=11124): Terminating (SIGTERM) 08:06:33.614540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11125): Terminating (SIGTERM) 08:06:33.653871 run iperf3-srv_10.42.42.10(pid=11126): Terminating (SIGTERM) 08:06:33.692825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11127): Terminating (SIGTERM) 08:06:33.732009 run iperf3-srv_10.42.42.10(pid=11128): Terminating (SIGTERM) 08:06:33.770993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11129): Terminating (SIGTERM) 08:06:33.810302 run iperf3-srv_10.42.42.10(pid=11130): Terminating (SIGTERM) 08:06:33.849251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11133): Terminating (SIGTERM) 08:06:33.888386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11136): Terminating (SIGTERM) 08:06:33.927516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11139): Terminating (SIGTERM) 08:06:33.967146 --- ParallelTerminationStrategy: PID 11123 died... 08:06:33.986257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11123): Terminated: ok {rc=0} 08:06:34.029849 --- ParallelTerminationStrategy: PID 11124 died... 08:06:34.048344 run iperf3-srv_10.42.42.10(pid=11124): Terminated {rc=256} 08:06:34.091529 --- ParallelTerminationStrategy: PID 11125 died... 08:06:34.110041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11125): Terminated: ok {rc=0} 08:06:34.153353 --- ParallelTerminationStrategy: PID 11126 died... 08:06:34.171626 run iperf3-srv_10.42.42.10(pid=11126): Terminated {rc=256} 08:06:34.215633 --- ParallelTerminationStrategy: PID 11127 died... 08:06:34.234178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11127): Terminated: ok {rc=0} 08:06:34.277426 --- ParallelTerminationStrategy: PID 11128 died... 08:06:34.296076 run iperf3-srv_10.42.42.10(pid=11128): Terminated {rc=256} 08:06:34.339529 --- ParallelTerminationStrategy: PID 11129 died... 08:06:34.358063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11129): Terminated: ok {rc=0} 08:06:34.402031 --- ParallelTerminationStrategy: PID 11130 died... 08:06:34.420652 run iperf3-srv_10.42.42.10(pid=11130): Terminated {rc=256} 08:06:34.464022 --- ParallelTerminationStrategy: PID 11133 died... 08:06:34.482627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11133): Terminated: ok {rc=0} 08:06:34.526182 --- ParallelTerminationStrategy: PID 11136 died... 08:06:34.544759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11136): Terminated: ok {rc=0} 08:06:34.588303 --- ParallelTerminationStrategy: PID 11139 died... 08:06:34.607086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11139): Terminated: ok {rc=0} 08:06:34.691626 bus /gobi_4: Setting Powered False 08:06:35.793144 bus /gobi_4: Setting Powered False 08:06:36.908480 bus /gobi_1: Setting Powered False 08:06:38.007211 bus /gobi_1: Setting Powered False 08:06:39.123232 bus /gobi_0: Setting Powered False 08:06:40.222730 bus /gobi_0: Setting Powered False 08:06:41.339673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 08:06:42.442005 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:42.454279 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:06:42.504775 tst ping.py: using LAC 20087 08:06:42.632872 tst ping.py: using RAC 197 08:06:42.752583 tst ping.py: using CellId 20087 08:06:42.872583 tst ping.py: using BVCI 20088 08:06:42.982010 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:42.993239 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:43.004077 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:43.014973 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:43.025715 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:43.036503 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:43.047596 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:43.058465 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:43.178099 tst ping.py:19: start network... 08:06:43.397686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:43.898369 run create_hlr_db(pid=11141): Launched 08:06:44.023019 bus /gobi_6: Setting Powered False 08:06:45.086149 run create_hlr_db(pid=11141): Terminated: ok {rc=0} 08:06:45.517028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Launched 08:06:45.817224 run osmo-hlr_10.42.42.2(pid=11144): Launched 08:06:46.065649 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:46.666819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Launched 08:06:47.010162 run osmo-stp_10.42.42.5(pid=11147): Launched 08:06:47.147628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:47.871696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Launched 08:06:47.985916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:48.239774 run patchelf(pid=11150): Launched 08:06:48.407444 run osmo-stp_10.42.42.5(pid=11147): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] 08:06:48.534363 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-09_08:06:46.948214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:48.662327 run osmo-stp_10.42.42.5(pid=11147): stderr: | 20221209080647317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080647317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080647318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080647318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080647318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080647319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080647319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:48.790589 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-09_08:06:46.948214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:48.914181 run osmo-stp_10.42.42.5(pid=11147): stderr: | 20221209080647317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080647317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080647318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080647318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080647318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080647319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080647319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:49.059641 run patchelf(pid=11150): Terminating (SIGINT) 08:06:49.227276 run patchelf(pid=11150): Terminated: ok {rc=0} 08:06:49.347922 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 08:06:49.356834 tst ping.py:22: Test FAILED (6.9 sec) 08:06:49.383694 run osmo-hlr_10.42.42.2(pid=11144): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11144)] 08:06:49.431281 run osmo-hlr_10.42.42.2(pid=11144): stdout: | (launched: 2022-12-09_08:06:45.761520) 08:06:49.479731 run osmo-hlr_10.42.42.2(pid=11144): stderr: | 20221209080645959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080645959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080645959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080645959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080645959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080645959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080645970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080645984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080645984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080645984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:49.528635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminating (SIGTERM) 08:06:49.567646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminating (SIGTERM) 08:06:49.606698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Terminating (SIGTERM) 08:06:49.646035 --- ParallelTerminationStrategy: PID 11143 died... 08:06:49.664929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminated: ok {rc=0} 08:06:49.708334 --- ParallelTerminationStrategy: PID 11146 died... 08:06:49.726882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminated: ok {rc=0} 08:06:49.770033 --- ParallelTerminationStrategy: PID 11149 died... 08:06:49.788308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Terminated: ok {rc=0} 08:06:49.870744 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:06:50.957030 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:50.972134 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:06:51.022805 tst ping_idle_ping.py: using LAC 20088 08:06:51.142417 tst ping_idle_ping.py: using RAC 198 08:06:51.262843 tst ping_idle_ping.py: using CellId 20088 08:06:51.385118 tst ping_idle_ping.py: using BVCI 20089 08:06:51.495592 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.506842 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.517823 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.528692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.539583 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.550476 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.561537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:06:51.572370 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:06:51.693315 tst ping_idle_ping.py:24: start network... 08:06:51.913746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:52.420417 run create_hlr_db(pid=11151): Launched 08:06:52.546569 bus /gobi_6: Setting Powered False 08:06:53.610763 run create_hlr_db(pid=11151): Terminated: ok {rc=0} 08:06:54.061465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11153): Launched 08:06:54.383469 run osmo-hlr_10.42.42.2(pid=11154): Launched 08:06:54.507513 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:55.068271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11156): Launched 08:06:55.392266 run osmo-stp_10.42.42.5(pid=11157): Launched 08:06:55.517174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:56.075823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11159): Launched 08:06:56.199963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:56.474469 run patchelf(pid=11160): Launched 08:06:56.655254 run osmo-stp_10.42.42.5(pid=11157): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11157)] 08:06:56.791608 run osmo-stp_10.42.42.5(pid=11157): stdout: | (launched: 2022-12-09_08:06:55.332533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:56.929853 run osmo-stp_10.42.42.5(pid=11157): stderr: | 20221209080655520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080655520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080655521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080655521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080655522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080655522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080655522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:57.067977 run osmo-stp_10.42.42.5(pid=11157): stdout: | (launched: 2022-12-09_08:06:55.332533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:57.200626 run osmo-stp_10.42.42.5(pid=11157): stderr: | 20221209080655520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080655520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080655521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080655521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080655522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080655522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080655522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:57.357344 run patchelf(pid=11160): Terminating (SIGINT) 08:06:57.537231 run patchelf(pid=11160): Terminated: ok {rc=0} 08:06:57.666970 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11157): Process ended prematurely: osmo-stp_10.42.42.5(pid=11157) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11157)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 08:06:57.676534 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:06:57.704697 run osmo-hlr_10.42.42.2(pid=11154): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11154)] 08:06:57.754536 run osmo-hlr_10.42.42.2(pid=11154): stdout: | (launched: 2022-12-09_08:06:54.324027) 08:06:57.805957 run osmo-hlr_10.42.42.2(pid=11154): stderr: | 20221209080654517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080654517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080654517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080654517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080654517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080654518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080654530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080654539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080654539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080654539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:57.857313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11153): Terminating (SIGTERM) 08:06:57.898694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11156): Terminating (SIGTERM) 08:06:57.940139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11159): Terminating (SIGTERM) 08:06:57.982041 --- ParallelTerminationStrategy: PID 11153 died... 08:06:58.001653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11153): Terminated: ok {rc=0} 08:06:58.047795 --- ParallelTerminationStrategy: PID 11156 died... 08:06:58.067082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11156): Terminated: ok {rc=0} 08:06:58.113577 --- ParallelTerminationStrategy: PID 11159 died... 08:06:58.133401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11159): Terminated: ok {rc=0} 08:06:58.221194 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:06:59.533165 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:06:59.541069 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:06:59.574729 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:06:59.615519 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:06:59.711114 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:06:59.744904 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:06:59.784248 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:07:00.379754 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:07:00.432269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:00.443826 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:07:00.511735 tst cs_paging_gprs_active.py: using LAC 20089 08:07:00.633392 tst cs_paging_gprs_active.py: using RAC 199 08:07:00.754121 tst cs_paging_gprs_active.py: using CellId 20089 08:07:00.879445 tst cs_paging_gprs_active.py: using BVCI 20090 08:07:01.013420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.025973 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.037600 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.049292 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.060705 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.072396 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.084119 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.095717 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:01.107754 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:01.232803 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:01.372029 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:07:01.600942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:01.941612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11165): Launched 08:07:02.243176 run iperf3-srv_10.42.42.10(pid=11166): Launched 08:07:02.368773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:07:02.590376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:02.920831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11167): Launched 08:07:03.206267 run iperf3-srv_10.42.42.10(pid=11168): Launched 08:07:03.330825 tst cs_paging_gprs_active.py:38: start network... 08:07:03.552584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:04.062836 run create_hlr_db(pid=11169): Launched 08:07:04.187281 bus /gobi_6: Setting Powered False 08:07:05.251373 run create_hlr_db(pid=11169): Terminated: ok {rc=0} 08:07:05.688815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11171): Launched 08:07:05.994585 run osmo-hlr_10.42.42.2(pid=11172): Launched 08:07:06.112276 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:06.652590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11174): Launched 08:07:06.959834 run osmo-stp_10.42.42.5(pid=11175): Launched 08:07:07.076716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:07.605465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11177): Launched 08:07:07.721468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:07.979762 run patchelf(pid=11178): Launched 08:07:08.149292 run osmo-stp_10.42.42.5(pid=11175): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11175)] 08:07:08.278565 run osmo-stp_10.42.42.5(pid=11175): stdout: | (launched: 2022-12-09_08:07:06.903114) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:08.409265 run osmo-stp_10.42.42.5(pid=11175): stderr: | 20221209080707072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080707072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080707073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080707073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080707073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080707073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080707074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:08.539925 run osmo-stp_10.42.42.5(pid=11175): stdout: | (launched: 2022-12-09_08:07:06.903114) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:08.664741 run osmo-stp_10.42.42.5(pid=11175): stderr: | 20221209080707072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080707072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080707073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080707073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080707073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080707073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080707074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:08.813331 run patchelf(pid=11178): Terminating (SIGINT) 08:07:08.983613 run patchelf(pid=11178): Terminated: ok {rc=0} 08:07:09.107158 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11175): Process ended prematurely: osmo-stp_10.42.42.5(pid=11175) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11175)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:07:09.116594 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:07:09.143749 run osmo-hlr_10.42.42.2(pid=11172): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11172)] 08:07:09.190719 run osmo-hlr_10.42.42.2(pid=11172): stdout: | (launched: 2022-12-09_08:07:05.937983) 08:07:09.239350 run osmo-hlr_10.42.42.2(pid=11172): stderr: | 20221209080706113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080706113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080706113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080706113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080706113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080706113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080706125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080706133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080706133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080706133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:09.289334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11165): Terminating (SIGTERM) 08:07:09.328491 run iperf3-srv_10.42.42.10(pid=11166): Terminating (SIGTERM) 08:07:09.367600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11167): Terminating (SIGTERM) 08:07:09.406926 run iperf3-srv_10.42.42.10(pid=11168): Terminating (SIGTERM) 08:07:09.447411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11171): Terminating (SIGTERM) 08:07:09.487100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11174): Terminating (SIGTERM) 08:07:09.526140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11177): Terminating (SIGTERM) 08:07:09.565495 --- ParallelTerminationStrategy: PID 11165 died... 08:07:09.584540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11165): Terminated: ok {rc=0} 08:07:09.628292 --- ParallelTerminationStrategy: PID 11166 died... 08:07:09.646909 run iperf3-srv_10.42.42.10(pid=11166): Terminated {rc=256} 08:07:09.690408 --- ParallelTerminationStrategy: PID 11167 died... 08:07:09.708904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11167): Terminated: ok {rc=0} 08:07:09.752361 --- ParallelTerminationStrategy: PID 11168 died... 08:07:09.770914 run iperf3-srv_10.42.42.10(pid=11168): Terminated {rc=256} 08:07:09.814392 --- ParallelTerminationStrategy: PID 11171 died... 08:07:09.832992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11171): Terminated: ok {rc=0} 08:07:09.876197 --- ParallelTerminationStrategy: PID 11174 died... 08:07:09.894711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11174): Terminated: ok {rc=0} 08:07:09.937979 --- ParallelTerminationStrategy: PID 11177 died... 08:07:09.956399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11177): Terminated: ok {rc=0} 08:07:10.042521 bus /gobi_0: Setting Powered False 08:07:11.143477 bus /gobi_0: Setting Powered False 08:07:12.258122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:07:13.403733 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:13.415484 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:07:13.486485 tst iperf3.py: using LAC 20090 08:07:13.607805 tst iperf3.py: using RAC 200 08:07:13.729025 tst iperf3.py: using CellId 20090 08:07:13.850302 tst iperf3.py: using BVCI 20091 08:07:13.971659 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:13.983508 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:13.995128 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:14.006905 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:14.018488 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:14.030141 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:14.042155 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:14.053534 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:14.065885 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:14.186745 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:07:14.393393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:14.701925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11179): Launched 08:07:14.968849 run iperf3-srv_10.42.42.10(pid=11180): Launched 08:07:15.084670 tst iperf3.py:8: start network... 08:07:15.291067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:15.765977 run create_hlr_db(pid=11181): Launched 08:07:15.904071 bus /gobi_6: Setting Powered False 08:07:16.963782 run create_hlr_db(pid=11181): Terminated: ok {rc=0} 08:07:17.401790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11183): Launched 08:07:17.731882 run osmo-hlr_10.42.42.2(pid=11184): Launched 08:07:17.858902 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:18.430993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11186): Launched 08:07:18.758961 run osmo-stp_10.42.42.5(pid=11187): Launched 08:07:18.885322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:19.451952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11189): Launched 08:07:19.578669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:19.858016 run patchelf(pid=11190): Launched 08:07:20.039548 run osmo-stp_10.42.42.5(pid=11187): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11187)] 08:07:20.178233 run osmo-stp_10.42.42.5(pid=11187): stdout: | (launched: 2022-12-09_08:07:18.698213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:20.318372 run osmo-stp_10.42.42.5(pid=11187): stderr: | 20221209080718888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080718888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080718889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080718889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080718889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080718890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080718890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:20.458966 run osmo-stp_10.42.42.5(pid=11187): stdout: | (launched: 2022-12-09_08:07:18.698213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:20.593484 run osmo-stp_10.42.42.5(pid=11187): stderr: | 20221209080718888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080718888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080718889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080718889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080718889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080718890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080718890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:20.753717 run patchelf(pid=11190): Terminating (SIGINT) 08:07:20.937229 run patchelf(pid=11190): Terminated: ok {rc=0} 08:07:21.069186 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11187): Process ended prematurely: osmo-stp_10.42.42.5(pid=11187) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11187)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 08:07:21.079450 tst iperf3.py:8: Test FAILED (7.7 sec) 08:07:21.108141 run osmo-hlr_10.42.42.2(pid=11184): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11184)] 08:07:21.157712 run osmo-hlr_10.42.42.2(pid=11184): stdout: | (launched: 2022-12-09_08:07:17.671659) 08:07:21.209291 run osmo-hlr_10.42.42.2(pid=11184): stderr: | 20221209080717866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080717866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080717866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080717866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080717866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080717866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080717878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080717887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080717888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080717888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:21.260912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11179): Terminating (SIGTERM) 08:07:21.302103 run iperf3-srv_10.42.42.10(pid=11180): Terminating (SIGTERM) 08:07:21.345122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11183): Terminating (SIGTERM) 08:07:21.386741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11186): Terminating (SIGTERM) 08:07:21.428066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11189): Terminating (SIGTERM) 08:07:21.469838 --- ParallelTerminationStrategy: PID 11179 died... 08:07:21.489447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11179): Terminated: ok {rc=0} 08:07:21.535801 --- ParallelTerminationStrategy: PID 11180 died... 08:07:21.555264 run iperf3-srv_10.42.42.10(pid=11180): Terminated {rc=256} 08:07:21.601227 --- ParallelTerminationStrategy: PID 11183 died... 08:07:21.620459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11183): Terminated: ok {rc=0} 08:07:21.666263 --- ParallelTerminationStrategy: PID 11186 died... 08:07:21.686074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11186): Terminated: ok {rc=0} 08:07:21.732469 --- ParallelTerminationStrategy: PID 11189 died... 08:07:21.752729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11189): Terminated: ok {rc=0} 08:07:21.842177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:07:22.991706 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.004065 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:07:23.073411 tst iperf3m4.py: using LAC 20091 08:07:23.202785 tst iperf3m4.py: using RAC 201 08:07:23.333309 tst iperf3m4.py: using CellId 20091 08:07:23.461954 tst iperf3m4.py: using BVCI 20092 08:07:23.582917 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.594636 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.606338 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.617713 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.628925 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.640390 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.651874 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.663695 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:23.675318 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:23.793901 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:23.918424 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:24.036548 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:24.155522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:07:24.362828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:24.671795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11191): Launched 08:07:24.939095 run iperf3-srv_10.42.42.10(pid=11192): Launched 08:07:25.053878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:07:25.260036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:25.568116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11193): Launched 08:07:25.835697 run iperf3-srv_10.42.42.10(pid=11194): Launched 08:07:25.950718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:07:26.157326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:26.465694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11195): Launched 08:07:26.731216 run iperf3-srv_10.42.42.10(pid=11196): Launched 08:07:26.845783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:07:27.050581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:27.359832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11197): Launched 08:07:27.626873 run iperf3-srv_10.42.42.10(pid=11198): Launched 08:07:27.742705 tst iperf3m4.py:8: start network... 08:07:27.948498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:28.422763 run create_hlr_db(pid=11199): Launched 08:07:28.550039 bus /gobi_6: Setting Powered False 08:07:29.610633 run create_hlr_db(pid=11199): Terminated: ok {rc=0} 08:07:30.037140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Launched 08:07:30.342959 run osmo-hlr_10.42.42.2(pid=11202): Launched 08:07:30.460267 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:31.009720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Launched 08:07:31.362082 run osmo-stp_10.42.42.5(pid=11205): Launched 08:07:31.611561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:32.256136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11207): Launched 08:07:32.383179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:32.662262 run patchelf(pid=11208): Launched 08:07:32.847401 run osmo-stp_10.42.42.5(pid=11205): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] 08:07:32.985641 run osmo-stp_10.42.42.5(pid=11205): stdout: | (launched: 2022-12-09_08:07:31.301195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:33.125331 run osmo-stp_10.42.42.5(pid=11205): stderr: | 20221209080731587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080731587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080731588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080731588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080731601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080731601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080731601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:33.264877 run osmo-stp_10.42.42.5(pid=11205): stdout: | (launched: 2022-12-09_08:07:31.301195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:33.399090 run osmo-stp_10.42.42.5(pid=11205): stderr: | 20221209080731587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080731587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080731588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080731588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080731601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080731601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080731601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:33.558340 run patchelf(pid=11208): Terminating (SIGINT) 08:07:33.741118 run patchelf(pid=11208): Terminated: ok {rc=0} 08:07:33.873644 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11205): Process ended prematurely: osmo-stp_10.42.42.5(pid=11205) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:07:33.884015 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:07:33.913059 run osmo-hlr_10.42.42.2(pid=11202): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11202)] 08:07:33.963277 run osmo-hlr_10.42.42.2(pid=11202): stdout: | (launched: 2022-12-09_08:07:30.285732) 08:07:34.015627 run osmo-hlr_10.42.42.2(pid=11202): stderr: | 20221209080730460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080730460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080730460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080730460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080730460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080730460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080730473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080730481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080730481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080730481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:34.067777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11191): Terminating (SIGTERM) 08:07:34.110788 run iperf3-srv_10.42.42.10(pid=11192): Terminating (SIGTERM) 08:07:34.153149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11193): Terminating (SIGTERM) 08:07:34.195074 run iperf3-srv_10.42.42.10(pid=11194): Terminating (SIGTERM) 08:07:34.236605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11195): Terminating (SIGTERM) 08:07:34.278690 run iperf3-srv_10.42.42.10(pid=11196): Terminating (SIGTERM) 08:07:34.320575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11197): Terminating (SIGTERM) 08:07:34.363213 run iperf3-srv_10.42.42.10(pid=11198): Terminating (SIGTERM) 08:07:34.404941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Terminating (SIGTERM) 08:07:34.447018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Terminating (SIGTERM) 08:07:34.488860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11207): Terminating (SIGTERM) 08:07:34.531164 --- ParallelTerminationStrategy: PID 11191 died... 08:07:34.550806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11191): Terminated: ok {rc=0} 08:07:34.597585 --- ParallelTerminationStrategy: PID 11192 died... 08:07:34.616889 run iperf3-srv_10.42.42.10(pid=11192): Terminated {rc=256} 08:07:34.663057 --- ParallelTerminationStrategy: PID 11193 died... 08:07:34.682900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11193): Terminated: ok {rc=0} 08:07:34.729254 --- ParallelTerminationStrategy: PID 11194 died... 08:07:34.748868 run iperf3-srv_10.42.42.10(pid=11194): Terminated {rc=256} 08:07:34.795285 --- ParallelTerminationStrategy: PID 11195 died... 08:07:34.815309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11195): Terminated: ok {rc=0} 08:07:34.861544 --- ParallelTerminationStrategy: PID 11196 died... 08:07:34.881353 run iperf3-srv_10.42.42.10(pid=11196): Terminated {rc=256} 08:07:34.927365 --- ParallelTerminationStrategy: PID 11197 died... 08:07:34.947221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11197): Terminated: ok {rc=0} 08:07:34.993600 --- ParallelTerminationStrategy: PID 11198 died... 08:07:35.013547 run iperf3-srv_10.42.42.10(pid=11198): Terminated {rc=256} 08:07:35.059305 --- ParallelTerminationStrategy: PID 11201 died... 08:07:35.079095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Terminated: ok {rc=0} 08:07:35.125324 --- ParallelTerminationStrategy: PID 11204 died... 08:07:35.145199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Terminated: ok {rc=0} 08:07:35.191857 --- ParallelTerminationStrategy: PID 11207 died... 08:07:35.211908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11207): Terminated: ok {rc=0} 08:07:35.303505 bus /gobi_4: Setting Powered False 08:07:36.403582 bus /gobi_4: Setting Powered False 08:07:37.520239 bus /gobi_1: Setting Powered False 08:07:38.618780 bus /gobi_1: Setting Powered False 08:07:39.734400 bus /gobi_0: Setting Powered False 08:07:40.832626 bus /gobi_0: Setting Powered False 08:07:41.949845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:07:43.051888 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.064373 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:07:43.133873 tst ping.py: using LAC 20092 08:07:43.260290 tst ping.py: using RAC 202 08:07:43.387121 tst ping.py: using CellId 20092 08:07:43.515438 tst ping.py: using BVCI 20093 08:07:43.627025 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.638419 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.649460 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.662407 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.673436 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.684451 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.695625 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:43.706671 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:43.825589 tst ping.py:19: start network... 08:07:44.045232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:44.548020 run create_hlr_db(pid=11209): Launched 08:07:44.672910 bus /gobi_6: Setting Powered False 08:07:45.737183 run create_hlr_db(pid=11209): Terminated: ok {rc=0} 08:07:46.203372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11211): Launched 08:07:46.528774 run osmo-hlr_10.42.42.2(pid=11212): Launched 08:07:46.725592 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:47.494986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11214): Launched 08:07:47.798622 run osmo-stp_10.42.42.5(pid=11215): Launched 08:07:47.913520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:48.434574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11217): Launched 08:07:48.551766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:48.807955 run patchelf(pid=11218): Launched 08:07:48.975780 run osmo-stp_10.42.42.5(pid=11215): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11215)] 08:07:49.102728 run osmo-stp_10.42.42.5(pid=11215): stdout: | (launched: 2022-12-09_08:07:47.741590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:49.231281 run osmo-stp_10.42.42.5(pid=11215): stderr: | 20221209080747907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080747907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080747907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080747908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080747908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080747908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080747908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:49.360174 run osmo-stp_10.42.42.5(pid=11215): stdout: | (launched: 2022-12-09_08:07:47.741590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:49.484192 run osmo-stp_10.42.42.5(pid=11215): stderr: | 20221209080747907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080747907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080747907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080747908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080747908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080747908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080747908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:49.630416 run patchelf(pid=11218): Terminating (SIGINT) 08:07:49.798464 run patchelf(pid=11218): Terminated: ok {rc=0} 08:07:49.919630 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11215): Process ended prematurely: osmo-stp_10.42.42.5(pid=11215) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11215)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 08:07:49.928619 tst ping.py:22: Test FAILED (6.9 sec) 08:07:49.955505 run osmo-hlr_10.42.42.2(pid=11212): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11212)] 08:07:50.002727 run osmo-hlr_10.42.42.2(pid=11212): stdout: | (launched: 2022-12-09_08:07:46.469322) 08:07:50.051331 run osmo-hlr_10.42.42.2(pid=11212): stderr: | 20221209080746869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080746869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080746869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080746870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080746870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080746870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080746899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080746919 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080746920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080746920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:50.100327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11211): Terminating (SIGTERM) 08:07:50.139268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11214): Terminating (SIGTERM) 08:07:50.178492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11217): Terminating (SIGTERM) 08:07:50.218083 --- ParallelTerminationStrategy: PID 11211 died... 08:07:50.236840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11211): Terminated: ok {rc=0} 08:07:50.280593 --- ParallelTerminationStrategy: PID 11214 died... 08:07:50.299266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11214): Terminated: ok {rc=0} 08:07:50.343472 --- ParallelTerminationStrategy: PID 11217 died... 08:07:50.362425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11217): Terminated: ok {rc=0} 08:07:50.445293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:07:51.533085 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:51.545674 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:07:51.616517 tst ping_idle_ping.py: using LAC 20093 08:07:51.744844 tst ping_idle_ping.py: using RAC 203 08:07:51.873616 tst ping_idle_ping.py: using CellId 20093 08:07:51.996316 tst ping_idle_ping.py: using BVCI 20094 08:07:52.107982 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.119380 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.130450 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.141544 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.152512 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.163455 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.174552 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:07:52.185543 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:07:52.305261 tst ping_idle_ping.py:24: start network... 08:07:52.527686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:53.036005 run create_hlr_db(pid=11219): Launched 08:07:53.161767 bus /gobi_6: Setting Powered False 08:07:54.226349 run create_hlr_db(pid=11219): Terminated: ok {rc=0} 08:07:54.658711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11221): Launched 08:07:54.964098 run osmo-hlr_10.42.42.2(pid=11222): Launched 08:07:55.079005 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:55.598298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11224): Launched 08:07:55.899469 run osmo-stp_10.42.42.5(pid=11225): Launched 08:07:56.013235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:56.532667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11227): Launched 08:07:56.647138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:56.901347 run patchelf(pid=11228): Launched 08:07:57.068684 run osmo-stp_10.42.42.5(pid=11225): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11225)] 08:07:57.195999 run osmo-stp_10.42.42.5(pid=11225): stdout: | (launched: 2022-12-09_08:07:55.843168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:57.325108 run osmo-stp_10.42.42.5(pid=11225): stderr: | 20221209080756011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080756011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080756011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080756012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080756012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080756012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080756012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:57.454974 run osmo-stp_10.42.42.5(pid=11225): stdout: | (launched: 2022-12-09_08:07:55.843168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:57.578915 run osmo-stp_10.42.42.5(pid=11225): stderr: | 20221209080756011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080756011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080756011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080756012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080756012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080756012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080756012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:57.725965 run patchelf(pid=11228): Terminating (SIGINT) 08:07:57.894748 run patchelf(pid=11228): Terminated: ok {rc=0} 08:07:58.015997 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11225): Process ended prematurely: osmo-stp_10.42.42.5(pid=11225) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11225)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:07:58.025136 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:07:58.052147 run osmo-hlr_10.42.42.2(pid=11222): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11222)] 08:07:58.099440 run osmo-hlr_10.42.42.2(pid=11222): stdout: | (launched: 2022-12-09_08:07:54.907147) 08:07:58.148809 run osmo-hlr_10.42.42.2(pid=11222): stderr: | 20221209080755080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080755080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080755080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080755080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080755080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080755080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080755093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080755101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080755101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080755101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:58.198148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11221): Terminating (SIGTERM) 08:07:58.237083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11224): Terminating (SIGTERM) 08:07:58.276379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11227): Terminating (SIGTERM) 08:07:58.315917 --- ParallelTerminationStrategy: PID 11221 died... 08:07:58.334691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11221): Terminated: ok {rc=0} 08:07:58.378304 --- ParallelTerminationStrategy: PID 11224 died... 08:07:58.396908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11224): Terminated: ok {rc=0} 08:07:58.440287 --- ParallelTerminationStrategy: PID 11227 died... 08:07:58.458798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11227): Terminated: ok {rc=0} 08:07:58.541068 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:07:59.855800 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:07:59.863948 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:07:59.897664 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:07:59.937813 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:08:00.025742 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:08:00.060999 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:08:00.100577 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:08:00.705536 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:08:00.757314 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:00.769877 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:08:00.820003 tst cs_paging_gprs_active.py: using LAC 20094 08:08:00.965740 tst cs_paging_gprs_active.py: using RAC 204 08:08:01.098219 tst cs_paging_gprs_active.py: using CellId 20094 08:08:01.225644 tst cs_paging_gprs_active.py: using BVCI 20095 08:08:01.350459 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.363570 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.376393 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.389325 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.402226 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.415091 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.428017 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.440741 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:01.454005 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:01.582734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:01.737802 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:08:02.018115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:02.361689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11272): Launched 08:08:02.679980 run iperf3-srv_10.42.42.10(pid=11283): Launched 08:08:02.817833 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:08:03.066948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:03.451569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11329): Launched 08:08:03.817427 run iperf3-srv_10.42.42.10(pid=11377): Launched 08:08:03.975076 tst cs_paging_gprs_active.py:38: start network... 08:08:04.235968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:04.834310 run create_hlr_db(pid=11505): Launched 08:08:04.998800 bus /gobi_6: Setting Powered False 08:08:06.062631 run create_hlr_db(pid=11505): Terminated: ok {rc=0} 08:08:06.527347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11508): Launched 08:08:06.874130 run osmo-hlr_10.42.42.2(pid=11510): Launched 08:08:07.068482 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:07.747111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11513): Launched 08:08:08.090321 run osmo-stp_10.42.42.5(pid=11514): Launched 08:08:08.335835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:08.988046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11516): Launched 08:08:09.125696 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:09.415586 run patchelf(pid=11517): Launched 08:08:09.615195 run osmo-stp_10.42.42.5(pid=11514): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11514)] 08:08:09.758925 run osmo-stp_10.42.42.5(pid=11514): stdout: | (launched: 2022-12-09_08:08:08.030869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:09.904071 run osmo-stp_10.42.42.5(pid=11514): stderr: | 20221209080808319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080808319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080808319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080808320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080808321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080808321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080808321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:10.052089 run osmo-stp_10.42.42.5(pid=11514): stdout: | (launched: 2022-12-09_08:08:08.030869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:10.191821 run osmo-stp_10.42.42.5(pid=11514): stderr: | 20221209080808319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080808319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080808319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080808320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080808321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080808321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080808321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:10.359591 run patchelf(pid=11517): Terminating (SIGINT) 08:08:10.550723 run patchelf(pid=11517): Terminated: ok {rc=0} 08:08:10.691740 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11514): Process ended prematurely: osmo-stp_10.42.42.5(pid=11514) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11514)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:08:10.702549 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 08:08:10.731940 run osmo-hlr_10.42.42.2(pid=11510): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11510)] 08:08:10.785146 run osmo-hlr_10.42.42.2(pid=11510): stdout: | (launched: 2022-12-09_08:08:06.813929) 08:08:10.838395 run osmo-hlr_10.42.42.2(pid=11510): stderr: | 20221209080807144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080807144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080807144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080807144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080807144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080807144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080807168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080807176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080807181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080807181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:10.892435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11272): Terminating (SIGTERM) 08:08:10.938329 run iperf3-srv_10.42.42.10(pid=11283): Terminating (SIGTERM) 08:08:10.988270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11329): Terminating (SIGTERM) 08:08:11.033516 run iperf3-srv_10.42.42.10(pid=11377): Terminating (SIGTERM) 08:08:11.079553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11508): Terminating (SIGTERM) 08:08:11.123744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11513): Terminating (SIGTERM) 08:08:11.172056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11516): Terminating (SIGTERM) 08:08:11.220553 --- ParallelTerminationStrategy: PID 11272 died... 08:08:11.242461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11272): Terminated: ok {rc=0} 08:08:11.293461 --- ParallelTerminationStrategy: PID 11283 died... 08:08:11.315357 run iperf3-srv_10.42.42.10(pid=11283): Terminated {rc=256} 08:08:11.364808 --- ParallelTerminationStrategy: PID 11329 died... 08:08:11.386785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11329): Terminated: ok {rc=0} 08:08:11.435797 --- ParallelTerminationStrategy: PID 11377 died... 08:08:11.457890 run iperf3-srv_10.42.42.10(pid=11377): Terminated {rc=256} 08:08:11.507647 --- ParallelTerminationStrategy: PID 11508 died... 08:08:11.529094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11508): Terminated: ok {rc=0} 08:08:11.580449 --- ParallelTerminationStrategy: PID 11513 died... 08:08:11.601350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11513): Terminated: ok {rc=0} 08:08:11.650191 --- ParallelTerminationStrategy: PID 11516 died... 08:08:11.672764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11516): Terminated: ok {rc=0} 08:08:11.767344 bus /gobi_0: Setting Powered False 08:08:12.875452 bus /gobi_0: Setting Powered False 08:08:13.998125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:08:15.156075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.169956 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:08:15.224288 tst iperf3.py: using LAC 20095 08:08:15.360451 tst iperf3.py: using RAC 205 08:08:15.494544 tst iperf3.py: using CellId 20095 08:08:15.630166 tst iperf3.py: using BVCI 20096 08:08:15.756356 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.769932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.783934 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.796889 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.811406 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.824478 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.843113 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.856288 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:15.869755 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:16.010781 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:08:16.250498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:16.596022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11518): Launched 08:08:16.899971 run iperf3-srv_10.42.42.10(pid=11519): Launched 08:08:17.040711 tst iperf3.py:8: start network... 08:08:17.271984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:17.808179 run create_hlr_db(pid=11520): Launched 08:08:18.029446 bus /gobi_6: Setting Powered False 08:08:19.096553 run create_hlr_db(pid=11520): Terminated: ok {rc=0} 08:08:19.575656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11522): Launched 08:08:19.929023 run osmo-hlr_10.42.42.2(pid=11523): Launched 08:08:20.184541 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:20.872570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11525): Launched 08:08:21.226428 run osmo-stp_10.42.42.5(pid=11526): Launched 08:08:21.479917 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:22.140266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11528): Launched 08:08:22.282264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:22.573569 run patchelf(pid=11529): Launched 08:08:22.779758 run osmo-stp_10.42.42.5(pid=11526): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11526)] 08:08:22.924619 run osmo-stp_10.42.42.5(pid=11526): stdout: | (launched: 2022-12-09_08:08:21.163506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:23.071306 run osmo-stp_10.42.42.5(pid=11526): stderr: | 20221209080821452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080821453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080821453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080821453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080821454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080821454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080821454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:23.218642 run osmo-stp_10.42.42.5(pid=11526): stdout: | (launched: 2022-12-09_08:08:21.163506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:23.359741 run osmo-stp_10.42.42.5(pid=11526): stderr: | 20221209080821452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080821453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080821453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080821453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080821454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080821454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080821454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:23.528337 run patchelf(pid=11529): Terminating (SIGINT) 08:08:23.720435 run patchelf(pid=11529): Terminated: ok {rc=0} 08:08:23.859321 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11526): Process ended prematurely: osmo-stp_10.42.42.5(pid=11526) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11526)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:08:23.871158 tst iperf3.py:8: Test FAILED (8.8 sec) 08:08:23.901928 run osmo-hlr_10.42.42.2(pid=11523): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11523)] 08:08:23.956353 run osmo-hlr_10.42.42.2(pid=11523): stdout: | (launched: 2022-12-09_08:08:19.866782) 08:08:24.011706 run osmo-hlr_10.42.42.2(pid=11523): stderr: | 20221209080820175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080820175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080820175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080820175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080820175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080820175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080820195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080820203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080820203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080820203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:24.066438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11518): Terminating (SIGTERM) 08:08:24.111553 run iperf3-srv_10.42.42.10(pid=11519): Terminating (SIGTERM) 08:08:24.158963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11522): Terminating (SIGTERM) 08:08:24.204741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11525): Terminating (SIGTERM) 08:08:24.253887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11528): Terminating (SIGTERM) 08:08:24.300298 --- ParallelTerminationStrategy: PID 11518 died... 08:08:24.321866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11518): Terminated: ok {rc=0} 08:08:24.371714 --- ParallelTerminationStrategy: PID 11519 died... 08:08:24.393968 run iperf3-srv_10.42.42.10(pid=11519): Terminated {rc=256} 08:08:24.447562 --- ParallelTerminationStrategy: PID 11522 died... 08:08:24.469905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11522): Terminated: ok {rc=0} 08:08:24.519902 --- ParallelTerminationStrategy: PID 11525 died... 08:08:24.541337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11525): Terminated: ok {rc=0} 08:08:24.593184 --- ParallelTerminationStrategy: PID 11528 died... 08:08:24.613905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11528): Terminated: ok {rc=0} 08:08:24.710305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:08:25.867028 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:25.880528 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:08:25.938323 tst iperf3m4.py: using LAC 20096 08:08:26.067831 tst iperf3m4.py: using RAC 206 08:08:26.198803 tst iperf3m4.py: using CellId 20096 08:08:26.326915 tst iperf3m4.py: using BVCI 20097 08:08:26.446637 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.458949 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.470834 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.482715 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.494551 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.506456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.518421 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.530188 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:26.542317 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:26.664450 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:26.792743 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:26.912537 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:27.031215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:08:27.239903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:27.551218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11532): Launched 08:08:27.823140 run iperf3-srv_10.42.42.10(pid=11533): Launched 08:08:27.938794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:08:28.145844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:28.457386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11534): Launched 08:08:28.726647 run iperf3-srv_10.42.42.10(pid=11535): Launched 08:08:28.844004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:08:29.050146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:29.360876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11536): Launched 08:08:29.630943 run iperf3-srv_10.42.42.10(pid=11537): Launched 08:08:29.749600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:08:29.956486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:30.267435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11538): Launched 08:08:30.538858 run iperf3-srv_10.42.42.10(pid=11539): Launched 08:08:30.656078 tst iperf3m4.py:8: start network... 08:08:30.886114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:31.429312 run create_hlr_db(pid=11540): Launched 08:08:31.592388 bus /gobi_6: Setting Powered False 08:08:32.656650 run create_hlr_db(pid=11540): Terminated: ok {rc=0} 08:08:33.101759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11542): Launched 08:08:33.410934 run osmo-hlr_10.42.42.2(pid=11543): Launched 08:08:33.529178 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:34.066052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11545): Launched 08:08:34.378437 run osmo-stp_10.42.42.5(pid=11546): Launched 08:08:34.498290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:35.034171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11548): Launched 08:08:35.151987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:35.414513 run patchelf(pid=11549): Launched 08:08:35.587016 run osmo-stp_10.42.42.5(pid=11546): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11546)] 08:08:35.717071 run osmo-stp_10.42.42.5(pid=11546): stdout: | (launched: 2022-12-09_08:08:34.320396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:35.849316 run osmo-stp_10.42.42.5(pid=11546): stderr: | 20221209080834489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080834490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080834490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080834490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080834491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080834491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080834491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:35.980702 run osmo-stp_10.42.42.5(pid=11546): stdout: | (launched: 2022-12-09_08:08:34.320396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:36.107079 run osmo-stp_10.42.42.5(pid=11546): stderr: | 20221209080834489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080834490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080834490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080834490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080834491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080834491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080834491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:36.256852 run patchelf(pid=11549): Terminating (SIGINT) 08:08:36.428650 run patchelf(pid=11549): Terminated: ok {rc=0} 08:08:36.552895 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11546): Process ended prematurely: osmo-stp_10.42.42.5(pid=11546) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11546)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:08:36.562905 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:08:36.590540 run osmo-hlr_10.42.42.2(pid=11543): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11543)] 08:08:36.638309 run osmo-hlr_10.42.42.2(pid=11543): stdout: | (launched: 2022-12-09_08:08:33.353065) 08:08:36.687747 run osmo-hlr_10.42.42.2(pid=11543): stderr: | 20221209080833530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080833530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080833530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080833530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080833530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080833530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080833542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080833550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080833551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080833551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:36.737569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11532): Terminating (SIGTERM) 08:08:36.777137 run iperf3-srv_10.42.42.10(pid=11533): Terminating (SIGTERM) 08:08:36.817225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11534): Terminating (SIGTERM) 08:08:36.857229 run iperf3-srv_10.42.42.10(pid=11535): Terminating (SIGTERM) 08:08:36.896540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11536): Terminating (SIGTERM) 08:08:36.935847 run iperf3-srv_10.42.42.10(pid=11537): Terminating (SIGTERM) 08:08:36.975040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11538): Terminating (SIGTERM) 08:08:37.014534 run iperf3-srv_10.42.42.10(pid=11539): Terminating (SIGTERM) 08:08:37.053812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11542): Terminating (SIGTERM) 08:08:37.093822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11545): Terminating (SIGTERM) 08:08:37.133546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11548): Terminating (SIGTERM) 08:08:37.173628 --- ParallelTerminationStrategy: PID 11532 died... 08:08:37.192882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11532): Terminated: ok {rc=0} 08:08:37.237123 --- ParallelTerminationStrategy: PID 11533 died... 08:08:37.256180 run iperf3-srv_10.42.42.10(pid=11533): Terminated {rc=256} 08:08:37.299963 --- ParallelTerminationStrategy: PID 11534 died... 08:08:37.318643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11534): Terminated: ok {rc=0} 08:08:37.362564 --- ParallelTerminationStrategy: PID 11535 died... 08:08:37.381254 run iperf3-srv_10.42.42.10(pid=11535): Terminated {rc=256} 08:08:37.425195 --- ParallelTerminationStrategy: PID 11536 died... 08:08:37.443757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11536): Terminated: ok {rc=0} 08:08:37.487802 --- ParallelTerminationStrategy: PID 11537 died... 08:08:37.506431 run iperf3-srv_10.42.42.10(pid=11537): Terminated {rc=256} 08:08:37.550296 --- ParallelTerminationStrategy: PID 11538 died... 08:08:37.569079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11538): Terminated: ok {rc=0} 08:08:37.613158 --- ParallelTerminationStrategy: PID 11539 died... 08:08:37.631700 run iperf3-srv_10.42.42.10(pid=11539): Terminated {rc=256} 08:08:37.675735 --- ParallelTerminationStrategy: PID 11542 died... 08:08:37.694383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11542): Terminated: ok {rc=0} 08:08:37.738685 --- ParallelTerminationStrategy: PID 11545 died... 08:08:37.757549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11545): Terminated: ok {rc=0} 08:08:37.801730 --- ParallelTerminationStrategy: PID 11548 died... 08:08:37.820342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11548): Terminated: ok {rc=0} 08:08:37.905092 bus /gobi_4: Setting Powered False 08:08:39.001931 bus /gobi_4: Setting Powered False 08:08:40.117746 bus /gobi_1: Setting Powered False 08:08:41.216201 bus /gobi_1: Setting Powered False 08:08:42.332223 bus /gobi_0: Setting Powered False 08:08:43.430909 bus /gobi_0: Setting Powered False 08:08:44.544814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:08:45.648116 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:45.660826 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:08:45.714124 tst ping.py: using LAC 20097 08:08:45.842535 tst ping.py: using RAC 207 08:08:45.975912 tst ping.py: using CellId 20097 08:08:46.100555 tst ping.py: using BVCI 20098 08:08:46.242234 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.254471 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.266413 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.279109 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.291262 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.303487 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.315789 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:46.327970 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:46.449560 tst ping.py:19: start network... 08:08:46.675277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:47.196709 run create_hlr_db(pid=11550): Launched 08:08:47.325078 bus /gobi_6: Setting Powered False 08:08:48.385375 run create_hlr_db(pid=11550): Terminated: ok {rc=0} 08:08:48.831157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11553): Launched 08:08:49.158094 run osmo-hlr_10.42.42.2(pid=11554): Launched 08:08:49.283269 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:49.849243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11556): Launched 08:08:50.175518 run osmo-stp_10.42.42.5(pid=11557): Launched 08:08:50.303082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:50.865152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11559): Launched 08:08:50.989947 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:51.265809 run patchelf(pid=11560): Launched 08:08:51.447339 run osmo-stp_10.42.42.5(pid=11557): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11557)] 08:08:51.584827 run osmo-stp_10.42.42.5(pid=11557): stdout: | (launched: 2022-12-09_08:08:50.115070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:51.723605 run osmo-stp_10.42.42.5(pid=11557): stderr: | 20221209080850310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080850310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080850310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080850311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080850311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080850311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080850311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:51.863621 run osmo-stp_10.42.42.5(pid=11557): stdout: | (launched: 2022-12-09_08:08:50.115070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:51.997247 run osmo-stp_10.42.42.5(pid=11557): stderr: | 20221209080850310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080850310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080850310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080850311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080850311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080850311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080850311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:52.155244 run patchelf(pid=11560): Terminating (SIGINT) 08:08:52.336324 run patchelf(pid=11560): Terminated: ok {rc=0} 08:08:52.466978 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11557): Process ended prematurely: osmo-stp_10.42.42.5(pid=11557) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11557)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:08:52.476925 tst ping.py:22: Test FAILED (6.8 sec) 08:08:52.505336 run osmo-hlr_10.42.42.2(pid=11554): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11554)] 08:08:52.555888 run osmo-hlr_10.42.42.2(pid=11554): stdout: | (launched: 2022-12-09_08:08:49.097584) 08:08:52.608218 run osmo-hlr_10.42.42.2(pid=11554): stderr: | 20221209080849299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080849299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080849299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080849299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080849299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080849299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080849311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080849319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080849319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080849319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:52.660533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11553): Terminating (SIGTERM) 08:08:52.702931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11556): Terminating (SIGTERM) 08:08:52.744799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11559): Terminating (SIGTERM) 08:08:52.787421 --- ParallelTerminationStrategy: PID 11553 died... 08:08:52.807557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11553): Terminated: ok {rc=0} 08:08:52.854545 --- ParallelTerminationStrategy: PID 11556 died... 08:08:52.874508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11556): Terminated: ok {rc=0} 08:08:52.921201 --- ParallelTerminationStrategy: PID 11559 died... 08:08:52.940817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11559): Terminated: ok {rc=0} 08:08:53.029259 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:08:54.114772 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.127288 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:08:54.178898 tst ping_idle_ping.py: using LAC 20098 08:08:54.307032 tst ping_idle_ping.py: using RAC 208 08:08:54.434301 tst ping_idle_ping.py: using CellId 20098 08:08:54.561320 tst ping_idle_ping.py: using BVCI 20099 08:08:54.680505 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.692851 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.705056 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.717147 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.728997 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.741415 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.753615 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:08:54.765765 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:08:54.886377 tst ping_idle_ping.py:24: start network... 08:08:55.090910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:55.568056 run create_hlr_db(pid=11561): Launched 08:08:55.694902 bus /gobi_6: Setting Powered False 08:08:56.754901 run create_hlr_db(pid=11561): Terminated: ok {rc=0} 08:08:57.180366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11563): Launched 08:08:57.487056 run osmo-hlr_10.42.42.2(pid=11564): Launched 08:08:57.602692 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:58.128458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11566): Launched 08:08:58.435890 run osmo-stp_10.42.42.5(pid=11567): Launched 08:08:58.553801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:59.079792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11569): Launched 08:08:59.197982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:59.455659 run patchelf(pid=11570): Launched 08:08:59.625990 run osmo-stp_10.42.42.5(pid=11567): ERR: Terminated: ERROR {rc=1} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11567)] 08:08:59.754211 run osmo-stp_10.42.42.5(pid=11567): stdout: | (launched: 2022-12-09_08:08:58.378541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:59.884442 run osmo-stp_10.42.42.5(pid=11567): stderr: | 20221209080858551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080858551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080858551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080858552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080858552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080858552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080858552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:00.014823 run osmo-stp_10.42.42.5(pid=11567): stdout: | (launched: 2022-12-09_08:08:58.378541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:00.139553 run osmo-stp_10.42.42.5(pid=11567): stderr: | 20221209080858551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080858551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080858551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080858552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080858552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080858552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080858552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:00.286834 run patchelf(pid=11570): Terminating (SIGINT) 08:09:00.455992 run patchelf(pid=11570): Terminated: ok {rc=0} 08:09:00.578363 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11567): Process ended prematurely: osmo-stp_10.42.42.5(pid=11567) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11567)] [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 08:09:00.587504 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:09:00.614373 run osmo-hlr_10.42.42.2(pid=11564): ERR: Terminated: ERROR {rc=237} [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11564)] 08:09:00.662298 run osmo-hlr_10.42.42.2(pid=11564): stdout: | (launched: 2022-12-09_08:08:57.429987) 08:09:00.711836 run osmo-hlr_10.42.42.2(pid=11564): stderr: | 20221209080857609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080857609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080857609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080857609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080857609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080857609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080857621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080857630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080857630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080857630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:00.761735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11563): Terminating (SIGTERM) 08:09:00.801599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11566): Terminating (SIGTERM) 08:09:00.851983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11569): Terminating (SIGTERM) 08:09:00.893595 --- ParallelTerminationStrategy: PID 11563 died... 08:09:00.912907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11563): Terminated: ok {rc=0} 08:09:00.959540 --- ParallelTerminationStrategy: PID 11566 died... 08:09:00.979137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11566): Terminated: ok {rc=0} 08:09:01.024463 --- ParallelTerminationStrategy: PID 11569 died... 08:09:01.043980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11569): Terminated: ok {rc=0} 08:09:01.130777 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 08:09:02.452144 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:09:02.460217 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:09:02.493282 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:09:02.528788 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:09:02.583498 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:09:02.618359 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:09:02.654575 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:09:03.213825 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2356 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:09:03.219764 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.232043 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:09:03.299428 tst switch_tch_pdch.py: using LAC 20099 08:09:03.429415 tst switch_tch_pdch.py: using RAC 209 08:09:03.550201 tst switch_tch_pdch.py: using CellId 20099 08:09:03.669009 tst switch_tch_pdch.py: using BVCI 20100 08:09:03.779344 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.792399 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.804259 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.816150 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.827934 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.839353 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.851030 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:09:03.863197 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:09:03.990286 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:09:04.113240 tst switch_tch_pdch.py:51: start network... 08:09:04.331587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:04.836677 run create_hlr_db(pid=11574): Launched 08:09:04.962946 bus /gobi_6: Setting Powered False 08:09:06.026848 run create_hlr_db(pid=11574): Terminated: ok {rc=0} 08:09:06.479478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11576): Launched 08:09:06.806528 run osmo-hlr_10.42.42.2(pid=11577): Launched 08:09:06.933272 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:07.497513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11579): Launched 08:09:07.825233 run osmo-stp_10.42.42.5(pid=11580): Launched 08:09:07.950280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:09:08.513005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11582): Launched 08:09:08.639086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:09:08.915692 run patchelf(pid=11583): Launched 08:09:09.098543 run osmo-stp_10.42.42.5(pid=11580): ERR: Terminated: ERROR {rc=1} [trial-2356↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11580)] 08:09:09.236137 run osmo-stp_10.42.42.5(pid=11580): stdout: | (launched: 2022-12-09_08:09:07.764060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:09.375462 run osmo-stp_10.42.42.5(pid=11580): stderr: | 20221209080907957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080907958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080907958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080907958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080907959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080907959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080907959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:09.515167 run osmo-stp_10.42.42.5(pid=11580): stdout: | (launched: 2022-12-09_08:09:07.764060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:09.648654 run osmo-stp_10.42.42.5(pid=11580): stderr: | 20221209080907957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080907958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080907958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080907958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080907959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080907959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080907959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:09.807575 run patchelf(pid=11583): Terminating (SIGINT) 08:09:09.989314 run patchelf(pid=11583): Terminated: ok {rc=0} 08:09:10.120176 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11580): Process ended prematurely: osmo-stp_10.42.42.5(pid=11580) [trial-2356↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11580)] [trial-2356↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:09:10.130054 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 08:09:10.158303 run osmo-hlr_10.42.42.2(pid=11577): ERR: Terminated: ERROR {rc=237} [trial-2356↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11577)] 08:09:10.208735 run osmo-hlr_10.42.42.2(pid=11577): stdout: | (launched: 2022-12-09_08:09:06.746069) 08:09:10.261447 run osmo-hlr_10.42.42.2(pid=11577): stderr: | 20221209080906944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080906944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080906944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080906944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080906944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080906944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080906958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080906966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080906966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080906966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:10.314690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11576): Terminating (SIGTERM) 08:09:10.357014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11579): Terminating (SIGTERM) 08:09:10.399554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11582): Terminating (SIGTERM) 08:09:10.442244 --- ParallelTerminationStrategy: PID 11576 died... 08:09:10.462367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11576): Terminated: ok {rc=0} 08:09:10.509061 --- ParallelTerminationStrategy: PID 11579 died... 08:09:10.528802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11579): Terminated: ok {rc=0} 08:09:10.575689 --- ParallelTerminationStrategy: PID 11582 died... 08:09:10.595308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11582): Terminated: ok {rc=0} 08:09:10.685123 bus /gobi_0: Setting Powered False 08:09:11.785322 bus /gobi_0: Setting Powered False 08:09:12.903805 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2356 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 nitb_smpp --------------------------------------------------------------------- 08:09:14.163169 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:09:14.165789 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 08:09:14.186699 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 08:09:14.193806 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 08:09:14.231976 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 08:09:14.253165 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 08:09:14.259821 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 08:09:14.781493 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2356 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 08:09:14.787721 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:09:14.822850 tst esme_connect_policy_acceptall.py: using MSISDN 7100 08:09:14.955903 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:09:15.522773 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11587): Launched 08:09:15.826855 run osmo-nitb_10.42.42.2(pid=11588): Launched 08:09:16.003462 run osmo-nitb_10.42.42.2(pid=11588): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11588)] 08:09:16.142423 run osmo-nitb_10.42.42.2(pid=11588): stdout: | (launched: 2022-12-09_08:09:15.769883) 08:09:16.281490 run osmo-nitb_10.42.42.2(pid=11588): stderr: | (launched: 2022-12-09_08:09:15.815102) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:16.421058 run osmo-nitb_10.42.42.2(pid=11588): stdout: | (launched: 2022-12-09_08:09:15.769883) 08:09:16.555447 run osmo-nitb_10.42.42.2(pid=11588): stderr: | (launched: 2022-12-09_08:09:15.815102) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11588): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11588) [trial-2356↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11588)] 08:09:16.949238 tst osmo-nitb_10.42.42.2(pid=11588): stdout: | (launched: 2022-12-09_08:09:15.769883) 08:09:17.076802 tst osmo-nitb_10.42.42.2(pid=11588): stderr: | (launched: 2022-12-09_08:09:15.815102) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:17.226623 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=11588): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11588) [trial-2356↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11588)] [trial-2356↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 08:09:17.235978 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 08:09:17.243469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11587): Terminating (SIGTERM) 08:09:17.453340 --- ParallelTerminationStrategy: PID 11587 died... 08:09:17.474064 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11587): Terminated: ok {rc=0} ---------------------------------------------- trial-2356 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 08:09:17.524473 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:09:17.546262 tst esme_connect_policy_closed.py: using MSISDN 7101 08:09:17.670269 tst esme_connect_policy_closed.py: using MSISDN 7102 08:09:17.789169 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:09:18.394313 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11589): Launched 08:09:18.719492 run osmo-nitb_10.42.42.2(pid=11590): Launched 08:09:18.895659 run osmo-nitb_10.42.42.2(pid=11590): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11590)] 08:09:19.029842 run osmo-nitb_10.42.42.2(pid=11590): stdout: | (launched: 2022-12-09_08:09:18.659660) 08:09:19.165825 run osmo-nitb_10.42.42.2(pid=11590): stderr: | (launched: 2022-12-09_08:09:18.708222) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:19.301684 run osmo-nitb_10.42.42.2(pid=11590): stdout: | (launched: 2022-12-09_08:09:18.659660) 08:09:19.431346 run osmo-nitb_10.42.42.2(pid=11590): stderr: | (launched: 2022-12-09_08:09:18.708222) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:19.587025 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=11590): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11590) [trial-2356↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11590)] [trial-2356↪nitb_smpp↪esme_connect_policy_closed.py:24] 08:09:19.595928 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 08:09:19.602917 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11589): Terminating (SIGTERM) 08:09:19.812721 --- ParallelTerminationStrategy: PID 11589 died... 08:09:19.833605 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11589): Terminated: ok {rc=0} ---------------------------------------------- trial-2356 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 08:09:19.883904 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:09:19.895549 tst nitb_smpp: Using 1 x bts (candidates: 1) 08:09:19.932462 tst esme_ms_sms_storeforward.py: using LAC 20100 08:09:20.060743 tst esme_ms_sms_storeforward.py: using RAC 210 08:09:20.189381 tst esme_ms_sms_storeforward.py: using CellId 20100 08:09:20.318078 tst esme_ms_sms_storeforward.py: using BVCI 20101 08:09:20.430144 tst nitb_smpp: Using 1 x modem (candidates: 1) 08:09:20.558563 tst esme_ms_sms_storeforward.py: using MSISDN 7103 08:09:20.668672 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 08:09:20.873168 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:09:21.495470 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11591): Launched 08:09:21.802177 run osmo-nitb_10.42.42.2(pid=11592): Launched 08:09:21.966848 run osmo-nitb_10.42.42.2(pid=11592): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11592)] 08:09:22.092879 run osmo-nitb_10.42.42.2(pid=11592): stdout: | (launched: 2022-12-09_08:09:21.745205) 08:09:22.220098 run osmo-nitb_10.42.42.2(pid=11592): stderr: | (launched: 2022-12-09_08:09:21.790614) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:22.347225 run osmo-nitb_10.42.42.2(pid=11592): stdout: | (launched: 2022-12-09_08:09:21.745205) 08:09:22.468185 run osmo-nitb_10.42.42.2(pid=11592): stderr: | (launched: 2022-12-09_08:09:21.790614) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:22.613167 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=11592): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11592) [trial-2356↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11592)] [trial-2356↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 08:09:22.621560 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 08:09:22.627974 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11591): Terminating (SIGTERM) 08:09:22.835759 --- ParallelTerminationStrategy: PID 11591 died... 08:09:22.855988 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11591): Terminated: ok {rc=0} 08:09:22.942331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 08:09:24.029886 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:09:24.041559 tst nitb_smpp: Using 1 x bts (candidates: 1) 08:09:24.078452 tst esme_ms_sms_transaction.py: using LAC 20101 08:09:24.201125 tst esme_ms_sms_transaction.py: using RAC 211 08:09:24.321386 tst esme_ms_sms_transaction.py: using CellId 20101 08:09:24.441058 tst esme_ms_sms_transaction.py: using BVCI 20102 08:09:24.553253 tst nitb_smpp: Using 1 x modem (candidates: 1) 08:09:24.686545 tst esme_ms_sms_transaction.py: using MSISDN 7104 08:09:24.807155 tst esme_ms_sms_transaction.py:18: start nitb and bts... 08:09:25.027172 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:09:25.688542 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11593): Launched 08:09:26.015728 run osmo-nitb_10.42.42.2(pid=11594): Launched 08:09:26.197348 run osmo-nitb_10.42.42.2(pid=11594): ERR: Terminated: ERROR {rc=2} [trial-2356↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11594)] 08:09:26.343364 run osmo-nitb_10.42.42.2(pid=11594): stdout: | (launched: 2022-12-09_08:09:25.955683) 08:09:26.490830 run osmo-nitb_10.42.42.2(pid=11594): stderr: | (launched: 2022-12-09_08:09:26.004478) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:26.637847 run osmo-nitb_10.42.42.2(pid=11594): stdout: | (launched: 2022-12-09_08:09:25.955683) 08:09:26.779836 run osmo-nitb_10.42.42.2(pid=11594): stderr: | (launched: 2022-12-09_08:09:26.004478) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11594): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11594) [trial-2356↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11594)] 08:09:27.139650 tst osmo-nitb_10.42.42.2(pid=11594): stdout: | (launched: 2022-12-09_08:09:25.955683) 08:09:27.270907 tst osmo-nitb_10.42.42.2(pid=11594): stderr: | (launched: 2022-12-09_08:09:26.004478) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:09:27.426259 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=11594): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11594) [trial-2356↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11594)] [trial-2356↪nitb_smpp↪esme_ms_sms_transaction.py:21] 08:09:27.435332 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 08:09:27.442350 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11593): Terminating (SIGTERM) 08:09:27.652368 --- ParallelTerminationStrategy: PID 11593 died... 08:09:27.673784 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11593): Terminated: ok {rc=0} 08:09:27.761882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 smpp --------------------------------------------------------------------- 08:09:28.930302 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:09:28.933154 tst smpp: Verifying 1 x bts (candidates: 11) 08:09:28.954452 tst smpp: Verifying 6 x ip_address (candidates: 9) 08:09:28.982016 tst smpp: Verifying 1 x modem (candidates: 12) 08:09:29.018599 tst smpp: Reserving 1 x bts (candidates: 11) 08:09:29.039880 tst smpp: Reserving 6 x ip_address (candidates: 9) 08:09:29.067117 tst smpp: Reserving 1 x modem (candidates: 12) 08:09:29.595207 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 08:09:29.600294 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:29.611137 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:29.622002 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:29.632676 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:29.651745 tst esme_connect_policy_acceptall.py: using MSISDN 7105 08:09:29.771573 run osmo-stp_10.42.42.4: Starting osmo-stp 08:09:30.327880 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11599): Launched 08:09:30.653300 run osmo-stp_10.42.42.4(pid=11600): Launched 08:09:30.771905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:31.320637 run create_hlr_db(pid=11601): Launched 08:09:31.454683 bus /sierra_2: Setting Powered False 08:09:32.518734 run create_hlr_db(pid=11601): Terminated: ok {rc=0} 08:09:32.978309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11603): Launched 08:09:33.307130 run osmo-hlr_10.42.42.2(pid=11604): Launched 08:09:33.434197 run osmo-msc_10.42.42.5: Starting osmo-msc 08:09:34.032348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11606): Launched 08:09:34.361757 run osmo-msc_10.42.42.5(pid=11607): Launched 08:09:34.544157 run osmo-hlr_10.42.42.2(pid=11604): ERR: Terminated: ERROR {rc=237} [trial-2356↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11604)] 08:09:34.682349 run osmo-hlr_10.42.42.2(pid=11604): stdout: | (launched: 2022-12-09_08:09:33.246695) 08:09:34.822162 run osmo-hlr_10.42.42.2(pid=11604): stderr: | 20221209080933442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080933442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080933455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080933465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080933465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080933465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:34.960725 run osmo-hlr_10.42.42.2(pid=11604): stdout: | (launched: 2022-12-09_08:09:33.246695) 08:09:35.091377 run osmo-hlr_10.42.42.2(pid=11604): stderr: | 20221209080933442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080933442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080933442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080933455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080933465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080933465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080933465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:35.247694 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=11604): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11604) [trial-2356↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11604)] [trial-2356↪smpp↪esme_connect_policy_acceptall.py:23] 08:09:35.256667 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 08:09:35.294700 run osmo-msc_10.42.42.5(pid=11607): ERR: Terminated: ERROR {rc=9} [trial-2356↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=11607)] 08:09:35.344937 run osmo-msc_10.42.42.5(pid=11607): stdout: | (launched: 2022-12-09_08:09:34.301064) 08:09:35.396059 run osmo-msc_10.42.42.5(pid=11607): stderr: | 20221209080934669 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209080934669 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209080934669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080934669 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209080934669 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209080934669 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209080934669 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209080934669 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209080934669 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 08:09:35.447474 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11599): Terminating (SIGTERM) 08:09:35.488728 run osmo-stp_10.42.42.4(pid=11600): Terminating (SIGTERM) 08:09:35.529695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11603): Terminating (SIGTERM) 08:09:35.572483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11606): Terminating (SIGTERM) 08:09:35.616606 --- ParallelTerminationStrategy: PID 11599 died... 08:09:35.636572 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11599): Terminated: ok {rc=0} 08:09:35.683598 --- ParallelTerminationStrategy: PID 11600 died... 08:09:35.703150 run osmo-stp_10.42.42.4(pid=11600): Terminated: ok {rc=0} 08:09:35.748619 --- ParallelTerminationStrategy: PID 11603 died... 08:09:35.767919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11603): Terminated: ok {rc=0} 08:09:35.814178 --- ParallelTerminationStrategy: PID 11606 died... 08:09:35.833314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11606): Terminated: ok {rc=0} ---------------------------------------------- trial-2356 smpp esme_connect_policy_closed.py ---------------------------------------------- 08:09:35.884149 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:35.895722 tst smpp: Using 1 x bts (candidates: 1) 08:09:35.932522 tst esme_connect_policy_closed.py: using LAC 20102 08:09:36.054380 tst esme_connect_policy_closed.py: using RAC 212 08:09:36.172746 tst esme_connect_policy_closed.py: using CellId 20102 08:09:36.294867 tst esme_connect_policy_closed.py: using BVCI 20103 08:09:36.405399 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:36.416315 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:36.427082 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:36.447154 tst esme_connect_policy_closed.py: using MSISDN 7106 08:09:36.572312 tst esme_connect_policy_closed.py: using MSISDN 7107 08:09:36.691276 run osmo-stp_10.42.42.4: Starting osmo-stp 08:09:37.240088 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11610): Launched 08:09:37.563435 run osmo-stp_10.42.42.4(pid=11611): Launched 08:09:37.686758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:38.189991 run create_hlr_db(pid=11612): Launched 08:09:39.371836 run create_hlr_db(pid=11612): Terminated: ok {rc=0} 08:09:39.715633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11614): Launched 08:09:40.042102 run osmo-hlr_10.42.42.2(pid=11615): Launched 08:09:40.166108 run osmo-msc_10.42.42.5: Starting osmo-msc 08:09:40.759317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11617): Launched 08:09:41.087300 run osmo-msc_10.42.42.5(pid=11618): Launched 08:09:41.269530 run osmo-hlr_10.42.42.2(pid=11615): ERR: Terminated: ERROR {rc=237} [trial-2356↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11615)] 08:09:41.407458 run osmo-hlr_10.42.42.2(pid=11615): stdout: | (launched: 2022-12-09_08:09:39.981908) 08:09:41.547342 run osmo-hlr_10.42.42.2(pid=11615): stderr: | 20221209080940175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080940175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080940187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080940196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080940197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080940197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:41.684572 run osmo-hlr_10.42.42.2(pid=11615): stdout: | (launched: 2022-12-09_08:09:39.981908) 08:09:41.815061 run osmo-hlr_10.42.42.2(pid=11615): stderr: | 20221209080940175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080940175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080940175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080940187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080940196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080940197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080940197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:41.970584 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=11615): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11615) [trial-2356↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11615)] [trial-2356↪smpp↪esme_connect_policy_closed.py:31] 08:09:41.979613 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 08:09:42.006891 run osmo-msc_10.42.42.5(pid=11618): ERR: Terminated: ERROR {rc=9} [trial-2356↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=11618)] 08:09:42.057078 run osmo-msc_10.42.42.5(pid=11618): stdout: | (launched: 2022-12-09_08:09:41.026891) 08:09:42.109238 run osmo-msc_10.42.42.5(pid=11618): stderr: | 20221209080941388 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209080941388 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209080941388 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080941388 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209080941388 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209080941388 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209080941389 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209080941389 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209080941389 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 08:09:42.161459 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11610): Terminating (SIGTERM) 08:09:42.203101 run osmo-stp_10.42.42.4(pid=11611): Terminating (SIGTERM) 08:09:42.245026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11614): Terminating (SIGTERM) 08:09:42.287915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11617): Terminating (SIGTERM) 08:09:42.334043 --- ParallelTerminationStrategy: PID 11610 died... 08:09:42.354398 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11610): Terminated: ok {rc=0} 08:09:42.402021 --- ParallelTerminationStrategy: PID 11611 died... 08:09:42.422385 run osmo-stp_10.42.42.4(pid=11611): Terminated: ok {rc=0} 08:09:42.469065 --- ParallelTerminationStrategy: PID 11614 died... 08:09:42.488421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11614): Terminated: ok {rc=0} 08:09:42.534500 --- ParallelTerminationStrategy: PID 11617 died... 08:09:42.554168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11617): Terminated: ok {rc=0} ---------------------------------------------- trial-2356 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 08:09:42.605311 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:42.616791 tst smpp: Using 1 x bts (candidates: 1) 08:09:42.653869 tst esme_ms_sms_storeforward.py: using LAC 20103 08:09:42.776250 tst esme_ms_sms_storeforward.py: using RAC 213 08:09:42.899101 tst esme_ms_sms_storeforward.py: using CellId 20103 08:09:43.021370 tst esme_ms_sms_storeforward.py: using BVCI 20104 08:09:43.132503 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:43.143138 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:43.153672 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:43.164125 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:43.174619 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:43.185062 tst smpp: Using 1 x modem (candidates: 1) 08:09:43.316022 tst esme_ms_sms_storeforward.py: using MSISDN 7108 08:09:43.434184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:43.941339 run create_hlr_db(pid=11621): Launched 08:09:45.124286 run create_hlr_db(pid=11621): Terminated: ok {rc=0} 08:09:45.468468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Launched 08:09:45.795762 run osmo-hlr_10.42.42.2(pid=11624): Launched 08:09:46.003518 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:46.724142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Launched 08:09:47.068468 run osmo-stp_10.42.42.5(pid=11627): Launched 08:09:47.301728 run osmo-msc_10.42.42.6: Starting osmo-msc 08:09:47.855229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11629): Launched 08:09:48.161389 run osmo-msc_10.42.42.6(pid=11630): Launched 08:09:48.332829 run osmo-stp_10.42.42.5(pid=11627): ERR: Terminated: ERROR {rc=1} [trial-2356↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11627)] 08:09:48.461552 run osmo-stp_10.42.42.5(pid=11627): stdout: | (launched: 2022-12-09_08:09:47.005781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:48.590317 run osmo-stp_10.42.42.5(pid=11627): stderr: | 20221209080947280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080947280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080947280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080947281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080947281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080947281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080947281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:48.717344 run osmo-stp_10.42.42.5(pid=11627): stdout: | (launched: 2022-12-09_08:09:47.005781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:48.838274 run osmo-stp_10.42.42.5(pid=11627): stderr: | 20221209080947280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080947280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080947280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080947281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080947281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080947281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080947281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:48.983373 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=11627): Process ended prematurely: osmo-stp_10.42.42.5(pid=11627) [trial-2356↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11627)] [trial-2356↪smpp↪esme_ms_sms_storeforward.py:30] 08:09:48.991945 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.4 sec) 08:09:49.017693 run osmo-hlr_10.42.42.2(pid=11624): ERR: Terminated: ERROR {rc=237} [trial-2356↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11624)] 08:09:49.065079 run osmo-hlr_10.42.42.2(pid=11624): stdout: | (launched: 2022-12-09_08:09:45.735362) 08:09:49.114535 run osmo-hlr_10.42.42.2(pid=11624): stderr: | 20221209080946033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080946033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080946034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080946034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080946034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080946034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080946052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080946062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080946062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080946062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:49.182707 run osmo-msc_10.42.42.6(pid=11630): ERR: Terminated: ERROR {rc=2} [trial-2356↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11630)] 08:09:49.230058 run osmo-msc_10.42.42.6(pid=11630): stdout: | (launched: 2022-12-09_08:09:48.104308) 08:09:49.279090 run osmo-msc_10.42.42.6(pid=11630): stderr: | 20221209080948376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080948376 DLGLOBAL DEBUG validating counter group 0x7f1dca4afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080948376 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080948376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080948376 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080948376 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080948378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080948379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080948379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080948379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:09:49.328257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Terminating (SIGTERM) 08:09:49.368146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Terminating (SIGTERM) 08:09:49.407803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11629): Terminating (SIGTERM) 08:09:49.447707 --- ParallelTerminationStrategy: PID 11623 died... 08:09:49.466805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Terminated: ok {rc=0} 08:09:49.510688 --- ParallelTerminationStrategy: PID 11626 died... 08:09:49.529081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Terminated: ok {rc=0} 08:09:49.572330 --- ParallelTerminationStrategy: PID 11629 died... 08:09:49.591092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11629): Terminated: ok {rc=0} 08:09:49.677266 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 smpp esme_ms_sms_transaction.py ---------------------------------------------- 08:09:50.765714 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:50.777485 tst smpp: Using 1 x bts (candidates: 1) 08:09:50.814196 tst esme_ms_sms_transaction.py: using LAC 20104 08:09:50.935920 tst esme_ms_sms_transaction.py: using RAC 214 08:09:51.056641 tst esme_ms_sms_transaction.py: using CellId 20104 08:09:51.177973 tst esme_ms_sms_transaction.py: using BVCI 20105 08:09:51.297221 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:51.309016 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:51.319860 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:51.330613 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:51.341360 tst smpp: Using 1 x ip_address (candidates: 6) 08:09:51.352072 tst smpp: Using 1 x modem (candidates: 1) 08:09:51.484848 tst esme_ms_sms_transaction.py: using MSISDN 7109 08:09:51.596681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:52.070916 run create_hlr_db(pid=11632): Launched 08:09:52.196051 bus /sierra_2: Setting Powered False 08:09:53.255773 run create_hlr_db(pid=11632): Terminated: ok {rc=0} 08:09:53.680633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11634): Launched 08:09:53.987399 run osmo-hlr_10.42.42.2(pid=11635): Launched 08:09:54.103320 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:54.643593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11637): Launched 08:09:54.947386 run osmo-stp_10.42.42.5(pid=11638): Launched 08:09:55.063641 run osmo-msc_10.42.42.6: Starting osmo-msc 08:09:55.616700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11640): Launched 08:09:55.933319 run osmo-msc_10.42.42.6(pid=11641): Launched 08:09:56.103393 run osmo-stp_10.42.42.5(pid=11638): ERR: Terminated: ERROR {rc=1} [trial-2356↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11638)] 08:09:56.232270 run osmo-stp_10.42.42.5(pid=11638): stdout: | (launched: 2022-12-09_08:09:54.890888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:56.362903 run osmo-stp_10.42.42.5(pid=11638): stderr: | 20221209080955059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080955060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080955060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080955060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080955061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080955061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080955061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:56.490913 run osmo-stp_10.42.42.5(pid=11638): stdout: | (launched: 2022-12-09_08:09:54.890888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:56.612376 run osmo-stp_10.42.42.5(pid=11638): stderr: | 20221209080955059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209080955060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209080955060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209080955060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209080955061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209080955061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209080955061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:56.757670 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=11638): Process ended prematurely: osmo-stp_10.42.42.5(pid=11638) [trial-2356↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11638)] [trial-2356↪smpp↪esme_ms_sms_transaction.py:28] 08:09:56.766115 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 08:09:56.792217 run osmo-hlr_10.42.42.2(pid=11635): ERR: Terminated: ERROR {rc=237} [trial-2356↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11635)] 08:09:56.840045 run osmo-hlr_10.42.42.2(pid=11635): stdout: | (launched: 2022-12-09_08:09:53.929743) 08:09:56.889200 run osmo-hlr_10.42.42.2(pid=11635): stderr: | 20221209080954103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209080954103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209080954103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209080954104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209080954104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209080954104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209080954115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209080954124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209080954124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209080954124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:56.957945 run osmo-msc_10.42.42.6(pid=11641): ERR: Terminated: ERROR {rc=2} [trial-2356↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11641)] 08:09:57.005364 run osmo-msc_10.42.42.6(pid=11641): stdout: | (launched: 2022-12-09_08:09:55.877862) 08:09:57.054110 run osmo-msc_10.42.42.6(pid=11641): stderr: | 20221209080956147 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209080956147 DLGLOBAL DEBUG validating counter group 0x7f5fd116dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209080956147 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209080956147 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209080956147 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209080956148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209080956149 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209080956150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209080956150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209080956150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:09:57.103023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11634): Terminating (SIGTERM) 08:09:57.142249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11637): Terminating (SIGTERM) 08:09:57.181501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11640): Terminating (SIGTERM) 08:09:57.221401 --- ParallelTerminationStrategy: PID 11634 died... 08:09:57.240500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11634): Terminated: ok {rc=0} 08:09:57.284235 --- ParallelTerminationStrategy: PID 11637 died... 08:09:57.303227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11637): Terminated: ok {rc=0} 08:09:57.346952 --- ParallelTerminationStrategy: PID 11640 died... 08:09:57.365691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11640): Terminated: ok {rc=0} 08:09:57.451646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 encryption --------------------------------------------------------------------- 08:09:58.644042 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:09:58.646874 tst encryption: Verifying 1 x bts (candidates: 11) 08:09:58.667752 tst encryption: Verifying 6 x ip_address (candidates: 9) 08:09:58.694525 tst encryption: Verifying 1 x modem (candidates: 12) 08:09:58.729213 tst encryption: Reserving 1 x bts (candidates: 11) 08:09:58.750380 tst encryption: Reserving 6 x ip_address (candidates: 9) 08:09:58.777363 tst encryption: Reserving 1 x modem (candidates: 12) 08:09:59.309875 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2356 encryption register_a5_0_authopt.py ---------------------------------------------- 08:09:59.364269 tst encryption: Using 1 x ip_address (candidates: 6) 08:09:59.375351 tst encryption: Using 1 x bts (candidates: 1) 08:09:59.414580 tst register_a5_0_authopt.py: using LAC 20105 08:09:59.546109 tst register_a5_0_authopt.py: using RAC 215 08:09:59.675332 tst register_a5_0_authopt.py: using CellId 20105 08:09:59.796389 tst register_a5_0_authopt.py: using BVCI 20106 08:09:59.908158 tst encryption: Using 1 x ip_address (candidates: 6) 08:09:59.919010 tst encryption: Using 1 x ip_address (candidates: 6) 08:09:59.929746 tst encryption: Using 1 x ip_address (candidates: 6) 08:09:59.940247 tst encryption: Using 1 x ip_address (candidates: 6) 08:09:59.950761 tst encryption: Using 1 x ip_address (candidates: 6) 08:09:59.961051 tst encryption: Using 1 x modem (candidates: 1) 08:10:00.076172 tst register_a5_0_authopt.py:8: start network... 08:10:00.284095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:00.764273 run create_hlr_db(pid=11646): Launched 08:10:00.924807 bus /sierra_2: Setting Powered False 08:10:02.002158 run create_hlr_db(pid=11646): Terminated: ok {rc=0} 08:10:02.466948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11651): Launched 08:10:02.798511 run osmo-hlr_10.42.42.2(pid=11652): Launched 08:10:02.925586 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:03.493640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11654): Launched 08:10:03.822413 run osmo-stp_10.42.42.5(pid=11655): Launched 08:10:03.947850 run osmo-msc_10.42.42.6: Starting osmo-msc 08:10:04.541684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11657): Launched 08:10:04.870747 run osmo-msc_10.42.42.6(pid=11658): Launched 08:10:05.056071 run osmo-stp_10.42.42.5(pid=11655): ERR: Terminated: ERROR {rc=1} [trial-2356↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11655)] 08:10:05.195549 run osmo-stp_10.42.42.5(pid=11655): stdout: | (launched: 2022-12-09_08:10:03.762561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:05.335576 run osmo-stp_10.42.42.5(pid=11655): stderr: | 20221209081003950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081003950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081003950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081003951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081003951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081003951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081003951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:05.472624 run osmo-stp_10.42.42.5(pid=11655): stdout: | (launched: 2022-12-09_08:10:03.762561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:05.604030 run osmo-stp_10.42.42.5(pid=11655): stderr: | 20221209081003950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081003950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081003950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081003951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081003951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081003951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081003951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:05.761657 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11655): Process ended prematurely: osmo-stp_10.42.42.5(pid=11655) [trial-2356↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11655)] [trial-2356↪encryption↪register_a5_0_authopt.py:8] 08:10:05.771374 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 08:10:05.799094 run osmo-hlr_10.42.42.2(pid=11652): ERR: Terminated: ERROR {rc=237} [trial-2356↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11652)] 08:10:05.849507 run osmo-hlr_10.42.42.2(pid=11652): stdout: | (launched: 2022-12-09_08:10:02.739209) 08:10:05.901872 run osmo-hlr_10.42.42.2(pid=11652): stderr: | 20221209081002932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081002932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081002932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081002932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081002932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081002932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081002943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081002951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081002952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081002952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:05.974191 run osmo-msc_10.42.42.6(pid=11658): ERR: Terminated: ERROR {rc=2} [trial-2356↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11658)] 08:10:06.024269 run osmo-msc_10.42.42.6(pid=11658): stdout: | (launched: 2022-12-09_08:10:04.810882) 08:10:06.075660 run osmo-msc_10.42.42.6(pid=11658): stderr: | 20221209081005128 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081005128 DLGLOBAL DEBUG validating counter group 0x7f61d4f0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081005128 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081005128 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081005128 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081005128 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081005130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081005130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081005131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081005131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:10:06.127524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11651): Terminating (SIGTERM) 08:10:06.169849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11654): Terminating (SIGTERM) 08:10:06.212228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11657): Terminating (SIGTERM) 08:10:06.254662 --- ParallelTerminationStrategy: PID 11651 died... 08:10:06.274599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11651): Terminated: ok {rc=0} 08:10:06.321256 --- ParallelTerminationStrategy: PID 11654 died... 08:10:06.341045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11654): Terminated: ok {rc=0} 08:10:06.387192 --- ParallelTerminationStrategy: PID 11657 died... 08:10:06.407032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11657): Terminated: ok {rc=0} 08:10:06.494690 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 encryption register_a5_0_authreq.py ---------------------------------------------- 08:10:07.644644 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:07.656407 tst encryption: Using 1 x bts (candidates: 1) 08:10:07.693860 tst register_a5_0_authreq.py: using LAC 20106 08:10:07.816622 tst register_a5_0_authreq.py: using RAC 216 08:10:07.938713 tst register_a5_0_authreq.py: using CellId 20106 08:10:08.061367 tst register_a5_0_authreq.py: using BVCI 20107 08:10:08.185749 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:08.196802 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:08.207765 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:08.218766 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:08.229579 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:08.240271 tst encryption: Using 1 x modem (candidates: 1) 08:10:08.357184 tst register_a5_0_authreq.py:8: start network... 08:10:08.564446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:09.041674 run create_hlr_db(pid=11660): Launched 08:10:09.171777 bus /sierra_2: Setting Powered False 08:10:10.237264 run create_hlr_db(pid=11660): Terminated: ok {rc=0} 08:10:10.695417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11662): Launched 08:10:11.027629 run osmo-hlr_10.42.42.2(pid=11663): Launched 08:10:11.154171 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:11.723365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11665): Launched 08:10:12.054837 run osmo-stp_10.42.42.5(pid=11666): Launched 08:10:12.182696 run osmo-msc_10.42.42.6: Starting osmo-msc 08:10:12.778902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11668): Launched 08:10:13.111081 run osmo-msc_10.42.42.6(pid=11669): Launched 08:10:13.295714 run osmo-stp_10.42.42.5(pid=11666): ERR: Terminated: ERROR {rc=1} [trial-2356↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11666)] 08:10:13.434903 run osmo-stp_10.42.42.5(pid=11666): stdout: | (launched: 2022-12-09_08:10:11.993885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:13.574780 run osmo-stp_10.42.42.5(pid=11666): stderr: | 20221209081012183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081012183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081012183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081012184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081012184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081012184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081012184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:13.712196 run osmo-stp_10.42.42.5(pid=11666): stdout: | (launched: 2022-12-09_08:10:11.993885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:13.844307 run osmo-stp_10.42.42.5(pid=11666): stderr: | 20221209081012183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081012183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081012183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081012184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081012184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081012184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081012184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:14.002145 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11666): Process ended prematurely: osmo-stp_10.42.42.5(pid=11666) [trial-2356↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11666)] [trial-2356↪encryption↪register_a5_0_authreq.py:8] 08:10:14.011877 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 08:10:14.039567 run osmo-hlr_10.42.42.2(pid=11663): ERR: Terminated: ERROR {rc=237} [trial-2356↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11663)] 08:10:14.089651 run osmo-hlr_10.42.42.2(pid=11663): stdout: | (launched: 2022-12-09_08:10:10.967584) 08:10:14.140846 run osmo-hlr_10.42.42.2(pid=11663): stderr: | 20221209081011161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081011161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081011161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081011162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081011162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081011162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081011179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081011190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081011190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081011190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:14.212916 run osmo-msc_10.42.42.6(pid=11669): ERR: Terminated: ERROR {rc=2} [trial-2356↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11669)] 08:10:14.262730 run osmo-msc_10.42.42.6(pid=11669): stdout: | (launched: 2022-12-09_08:10:13.051188) 08:10:14.314640 run osmo-msc_10.42.42.6(pid=11669): stderr: | 20221209081013369 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081013369 DLGLOBAL DEBUG validating counter group 0x7f082fc6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081013369 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081013369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081013369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081013370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081013371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081013372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081013372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081013372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:10:14.366251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11662): Terminating (SIGTERM) 08:10:14.408090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11665): Terminating (SIGTERM) 08:10:14.450133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11668): Terminating (SIGTERM) 08:10:14.492123 --- ParallelTerminationStrategy: PID 11662 died... 08:10:14.512633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11662): Terminated: ok {rc=0} 08:10:14.559963 --- ParallelTerminationStrategy: PID 11665 died... 08:10:14.579975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11665): Terminated: ok {rc=0} 08:10:14.626752 --- ParallelTerminationStrategy: PID 11668 died... 08:10:14.646527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11668): Terminated: ok {rc=0} 08:10:14.734505 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 encryption register_a5_1_authreq.py ---------------------------------------------- 08:10:15.894337 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:15.910581 tst encryption: Using 1 x bts (candidates: 1) 08:10:15.959939 tst register_a5_1_authreq.py: using LAC 20107 08:10:16.092695 tst register_a5_1_authreq.py: using RAC 217 08:10:16.217182 tst register_a5_1_authreq.py: using CellId 20107 08:10:16.355174 tst register_a5_1_authreq.py: using BVCI 20108 08:10:16.473267 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:16.484777 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:16.496127 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:16.507696 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:16.519034 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:16.530868 tst encryption: Using 1 x modem (candidates: 1) 08:10:16.648377 tst register_a5_1_authreq.py:8: start network... 08:10:16.896066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:17.420334 run create_hlr_db(pid=11671): Launched 08:10:17.550531 bus /sierra_2: Setting Powered False 08:10:18.615746 run create_hlr_db(pid=11671): Terminated: ok {rc=0} 08:10:19.056288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11673): Launched 08:10:19.365694 run osmo-hlr_10.42.42.2(pid=11674): Launched 08:10:19.482400 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:20.015195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11676): Launched 08:10:20.322249 run osmo-stp_10.42.42.5(pid=11677): Launched 08:10:20.440589 run osmo-msc_10.42.42.6: Starting osmo-msc 08:10:20.996070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11679): Launched 08:10:21.304174 run osmo-msc_10.42.42.6(pid=11680): Launched 08:10:21.476349 run osmo-stp_10.42.42.5(pid=11677): ERR: Terminated: ERROR {rc=1} [trial-2356↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11677)] 08:10:21.606688 run osmo-stp_10.42.42.5(pid=11677): stdout: | (launched: 2022-12-09_08:10:20.266096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:21.736579 run osmo-stp_10.42.42.5(pid=11677): stderr: | 20221209081020435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081020435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081020436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081020436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081020437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081020437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081020437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:21.864843 run osmo-stp_10.42.42.5(pid=11677): stdout: | (launched: 2022-12-09_08:10:20.266096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:21.987934 run osmo-stp_10.42.42.5(pid=11677): stderr: | 20221209081020435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081020435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081020436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081020436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081020437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081020437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081020437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:22.135099 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11677): Process ended prematurely: osmo-stp_10.42.42.5(pid=11677) [trial-2356↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11677)] [trial-2356↪encryption↪register_a5_1_authreq.py:8] 08:10:22.143885 tst register_a5_1_authreq.py:8: Test FAILED (6.3 sec) 08:10:22.169996 run osmo-hlr_10.42.42.2(pid=11674): ERR: Terminated: ERROR {rc=237} [trial-2356↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11674)] 08:10:22.217347 run osmo-hlr_10.42.42.2(pid=11674): stdout: | (launched: 2022-12-09_08:10:19.309124) 08:10:22.266709 run osmo-hlr_10.42.42.2(pid=11674): stderr: | 20221209081019481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081019481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081019481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081019481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081019481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081019481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081019494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081019502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081019502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081019502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:22.335281 run osmo-msc_10.42.42.6(pid=11680): ERR: Terminated: ERROR {rc=2} [trial-2356↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11680)] 08:10:22.382979 run osmo-msc_10.42.42.6(pid=11680): stdout: | (launched: 2022-12-09_08:10:21.247734) 08:10:22.431961 run osmo-msc_10.42.42.6(pid=11680): stderr: | 20221209081021515 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081021516 DLGLOBAL DEBUG validating counter group 0x7f8a740d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081021516 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081021516 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081021516 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081021516 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081021518 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081021518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081021519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081021519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:10:22.481380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11673): Terminating (SIGTERM) 08:10:22.520560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11676): Terminating (SIGTERM) 08:10:22.559869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11679): Terminating (SIGTERM) 08:10:22.599587 --- ParallelTerminationStrategy: PID 11673 died... 08:10:22.618620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11673): Terminated: ok {rc=0} 08:10:22.662257 --- ParallelTerminationStrategy: PID 11676 died... 08:10:22.680718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11676): Terminated: ok {rc=0} 08:10:22.725985 --- ParallelTerminationStrategy: PID 11679 died... 08:10:22.744617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11679): Terminated: ok {rc=0} 08:10:22.830972 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2356 encryption register_a5_3_authreq.py ---------------------------------------------- 08:10:23.982856 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:23.994679 tst encryption: Using 1 x bts (candidates: 1) 08:10:24.036014 tst register_a5_3_authreq.py: using LAC 20108 08:10:24.157235 tst register_a5_3_authreq.py: using RAC 218 08:10:24.277540 tst register_a5_3_authreq.py: using CellId 20108 08:10:24.398300 tst register_a5_3_authreq.py: using BVCI 20109 08:10:24.510067 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:24.520850 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:24.531532 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:24.542088 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:24.552613 tst encryption: Using 1 x ip_address (candidates: 6) 08:10:24.563111 tst encryption: Using 1 x modem (candidates: 1) 08:10:24.693624 tst register_a5_3_authreq.py:8: start network... 08:10:24.922261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:25.435606 run create_hlr_db(pid=11682): Launched 08:10:25.561614 bus /sierra_2: Setting Powered False 08:10:26.627241 run create_hlr_db(pid=11682): Terminated: ok {rc=0} 08:10:27.065527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11684): Launched 08:10:27.372680 run osmo-hlr_10.42.42.2(pid=11685): Launched 08:10:27.490859 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:28.033637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11687): Launched 08:10:28.340026 run osmo-stp_10.42.42.5(pid=11688): Launched 08:10:28.456866 run osmo-msc_10.42.42.6: Starting osmo-msc 08:10:29.013209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11690): Launched 08:10:29.322477 run osmo-msc_10.42.42.6(pid=11691): Launched 08:10:29.494280 run osmo-stp_10.42.42.5(pid=11688): ERR: Terminated: ERROR {rc=1} [trial-2356↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11688)] 08:10:29.624383 run osmo-stp_10.42.42.5(pid=11688): stdout: | (launched: 2022-12-09_08:10:28.284215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:29.754531 run osmo-stp_10.42.42.5(pid=11688): stderr: | 20221209081028450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081028450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081028451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081028451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081028451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081028451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081028452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:29.882938 run osmo-stp_10.42.42.5(pid=11688): stdout: | (launched: 2022-12-09_08:10:28.284215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:30.006276 run osmo-stp_10.42.42.5(pid=11688): stderr: | 20221209081028450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081028450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081028451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081028451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081028451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081028451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081028452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:30.154551 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11688): Process ended prematurely: osmo-stp_10.42.42.5(pid=11688) [trial-2356↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11688)] [trial-2356↪encryption↪register_a5_3_authreq.py:8] 08:10:30.163632 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 08:10:30.189650 run osmo-hlr_10.42.42.2(pid=11685): ERR: Terminated: ERROR {rc=237} [trial-2356↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11685)] 08:10:30.236801 run osmo-hlr_10.42.42.2(pid=11685): stdout: | (launched: 2022-12-09_08:10:27.316713) 08:10:30.286215 run osmo-hlr_10.42.42.2(pid=11685): stderr: | 20221209081027489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081027489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081027489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081027489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081027489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081027489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081027505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081027514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081027515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081027515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:30.354450 run osmo-msc_10.42.42.6(pid=11691): ERR: Terminated: ERROR {rc=2} [trial-2356↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11691)] 08:10:30.401607 run osmo-msc_10.42.42.6(pid=11691): stdout: | (launched: 2022-12-09_08:10:29.266274) 08:10:30.450393 run osmo-msc_10.42.42.6(pid=11691): stderr: | 20221209081029536 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081029536 DLGLOBAL DEBUG validating counter group 0x7f939a2cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081029536 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081029536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081029536 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081029536 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081029538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081029539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081029539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081029539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:10:30.499538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11684): Terminating (SIGTERM) 08:10:30.538925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11687): Terminating (SIGTERM) 08:10:30.578281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11690): Terminating (SIGTERM) 08:10:30.617718 --- ParallelTerminationStrategy: PID 11684 died... 08:10:30.637204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11684): Terminated: ok {rc=0} 08:10:30.680923 --- ParallelTerminationStrategy: PID 11687 died... 08:10:30.699740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11687): Terminated: ok {rc=0} 08:10:30.743350 --- ParallelTerminationStrategy: PID 11690 died... 08:10:30.761838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11690): Terminated: ok {rc=0} 08:10:30.845614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 08:10:32.064110 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:10:32.070798 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 08:10:32.091570 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 08:10:32.121196 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 08:10:32.150069 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 08:10:32.176724 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 08:10:32.208153 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 08:10:32.707812 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 08:10:32.713543 tst handover.py:11: TEST_CONFIG: {} 08:10:32.934828 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:10:32.951590 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:10:32.975741 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:10:33.024455 tst handover.py: using MSISDN 7110 08:10:33.146204 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7110', subscriber_id=0} 08:10:33.261834 run srsepc_10.42.42.118: Starting srsepc 08:10:35.169374 run rm-remote-dir(pid=11696): Launched 08:10:35.300376 bus /sierra_2: Setting Powered False 08:10:36.369407 run rm-remote-dir(pid=11696): Terminated: ok {rc=0} 08:10:36.840734 run mk-remote-dir(pid=11697): Launched 08:10:38.033182 run mk-remote-dir(pid=11697): Terminated: ok {rc=0} 08:10:38.338586 run scp-inst-to-remote(pid=11698): Launched 08:10:40.529654 run scp-inst-to-remote(pid=11698): Terminated: ok {rc=0} 08:10:40.886682 run rm-remote-dir(pid=11700): Launched 08:10:42.079459 run rm-remote-dir(pid=11700): Terminated: ok {rc=0} 08:10:42.437269 run mk-remote-dir(pid=11701): Launched 08:10:43.627997 run mk-remote-dir(pid=11701): Terminated: ok {rc=0} 08:10:43.934058 run scp-cfg-to-remote(pid=11702): Launched 08:10:45.121581 run scp-cfg-to-remote(pid=11702): Terminated: ok {rc=0} 08:10:45.425605 run scp-db-to-remote(pid=11704): Launched 08:10:46.613451 run scp-db-to-remote(pid=11704): Terminated: ok {rc=0} 08:10:46.757381 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:10:47.093754 run patchelf(pid=11706): Launched 08:10:48.315397 run patchelf(pid=11706): Terminated: ok {rc=0} 08:10:48.446296 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:10:48.755577 run setcap-netadm(pid=11707): Launched 08:10:49.931165 run setcap-netadm(pid=11707): Terminated: ok {rc=0} 08:10:50.253748 run srsepc(pid=11708): Launched 08:10:50.367673 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:10:51.472735 run rm-remote-dir(pid=11709): Launched 08:10:51.647438 run srsepc(pid=11708): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11708)] 08:10:51.781352 run srsepc(pid=11708): stdout: | (launched: 2022-12-09_08:10:50.197375) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:51.915975 run srsepc(pid=11708): stderr: | (launched: 2022-12-09_08:10:50.242932) | Connection to 10.42.42.116 closed. 08:10:52.050377 run srsepc(pid=11708): stdout: | (launched: 2022-12-09_08:10:50.197375) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:52.179354 run srsepc(pid=11708): stderr: | (launched: 2022-12-09_08:10:50.242932) | Connection to 10.42.42.116 closed. 08:10:52.332226 run rm-remote-dir(pid=11709): Terminating (SIGINT) 08:10:52.509266 run rm-remote-dir(pid=11709): Terminated: ok {rc=0} 08:10:52.637736 tst handover.py:37: ERR: Error: srsepc(pid=11708): Process ended prematurely: srsepc(pid=11708) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11708)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 08:10:52.647595 tst handover.py:37: Test FAILED (19.9 sec) 08:10:52.724786 run scp-back-log(pid=11710): Launched 08:10:53.800435 run scp-back-log(pid=11710): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11710)] 08:10:53.860923 run scp-back-log(pid=11710): stdout: | (launched: 2022-12-09_08:10:52.693827) 08:10:53.922928 run scp-back-log(pid=11710): stderr: | (launched: 2022-12-09_08:10:52.714092) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:10:53.992419 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11710): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11710)]') ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 08:10:54.037338 tst iperf3_bidir.py:13: Number of physical ue: 1 08:10:54.242979 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:10:54.285701 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 08:10:54.490460 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:10:54.506270 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:10:54.543219 tst iperf3_bidir.py: using MSISDN 7111 08:10:54.655453 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7111', subscriber_id=0} 08:10:54.762604 run srsepc_10.42.42.118: Starting srsepc 08:10:55.390021 run rm-remote-dir(pid=11712): Launched 08:10:56.569806 run rm-remote-dir(pid=11712): Terminated: ok {rc=0} 08:10:56.939169 run mk-remote-dir(pid=11713): Launched 08:10:58.131214 run mk-remote-dir(pid=11713): Terminated: ok {rc=0} 08:10:58.436692 run scp-inst-to-remote(pid=11714): Launched 08:11:00.626967 run scp-inst-to-remote(pid=11714): Terminated: ok {rc=0} 08:11:01.017956 run rm-remote-dir(pid=11716): Launched 08:11:02.313113 run rm-remote-dir(pid=11716): Terminated: ok {rc=0} 08:11:02.649847 run mk-remote-dir(pid=11717): Launched 08:11:03.827428 run mk-remote-dir(pid=11717): Terminated: ok {rc=0} 08:11:04.113587 run scp-cfg-to-remote(pid=11718): Launched 08:11:05.287617 run scp-cfg-to-remote(pid=11718): Terminated: ok {rc=0} 08:11:05.571218 run scp-db-to-remote(pid=11720): Launched 08:11:06.746981 run scp-db-to-remote(pid=11720): Terminated: ok {rc=0} 08:11:06.878289 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:11:07.187167 run patchelf(pid=11722): Launched 08:11:08.363252 run patchelf(pid=11722): Terminated: ok {rc=0} 08:11:08.503261 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:11:08.820383 run setcap-netadm(pid=11723): Launched 08:11:09.997102 run setcap-netadm(pid=11723): Terminated: ok {rc=0} 08:11:10.320806 run srsepc(pid=11724): Launched 08:11:10.434988 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:11:11.538124 run rm-remote-dir(pid=11725): Launched 08:11:11.715356 run srsepc(pid=11724): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11724)] 08:11:11.850297 run srsepc(pid=11724): stdout: | (launched: 2022-12-09_08:11:10.264326) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:11:11.986054 run srsepc(pid=11724): stderr: | (launched: 2022-12-09_08:11:10.309978) | Connection to 10.42.42.116 closed. 08:11:12.121386 run srsepc(pid=11724): stdout: | (launched: 2022-12-09_08:11:10.264326) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:11:12.250657 run srsepc(pid=11724): stderr: | (launched: 2022-12-09_08:11:10.309978) | Connection to 10.42.42.116 closed. 08:11:12.403274 run rm-remote-dir(pid=11725): Terminating (SIGINT) 08:11:12.579886 run rm-remote-dir(pid=11725): Terminated: ok {rc=0} 08:11:12.707711 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=11724): Process ended prematurely: srsepc(pid=11724) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11724)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 08:11:12.717912 tst iperf3_bidir.py:42: Test FAILED (18.7 sec) 08:11:12.795198 run scp-back-log(pid=11726): Launched 08:11:13.871131 run scp-back-log(pid=11726): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11726)] 08:11:13.931827 run scp-back-log(pid=11726): stdout: | (launched: 2022-12-09_08:11:12.764064) 08:11:13.994620 run scp-back-log(pid=11726): stderr: | (launched: 2022-12-09_08:11:12.784000) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:11:14.064641 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11726): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11726)]') ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 08:11:14.109962 tst iperf3_dl.py:13: Number of physical ue: 1 08:11:14.315769 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:11:14.360261 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 08:11:14.563479 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:11:14.579538 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:11:14.621664 tst iperf3_dl.py: using MSISDN 7112 08:11:14.734316 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7112', subscriber_id=0} 08:11:14.840877 run srsepc_10.42.42.118: Starting srsepc 08:11:15.465772 run rm-remote-dir(pid=11728): Launched 08:11:16.655220 run rm-remote-dir(pid=11728): Terminated: ok {rc=0} 08:11:17.081972 run mk-remote-dir(pid=11729): Launched 08:11:18.317752 run mk-remote-dir(pid=11729): Terminated: ok {rc=0} 08:11:18.603491 run scp-inst-to-remote(pid=11730): Launched 08:11:20.784781 run scp-inst-to-remote(pid=11730): Terminated: ok {rc=0} 08:11:21.141438 run rm-remote-dir(pid=11732): Launched 08:11:22.331444 run rm-remote-dir(pid=11732): Terminated: ok {rc=0} 08:11:22.688604 run mk-remote-dir(pid=11733): Launched 08:11:23.880332 run mk-remote-dir(pid=11733): Terminated: ok {rc=0} 08:11:24.185052 run scp-cfg-to-remote(pid=11734): Launched 08:11:25.372336 run scp-cfg-to-remote(pid=11734): Terminated: ok {rc=0} 08:11:25.674398 run scp-db-to-remote(pid=11736): Launched 08:11:26.864172 run scp-db-to-remote(pid=11736): Terminated: ok {rc=0} 08:11:27.003749 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:11:27.333593 run patchelf(pid=11738): Launched 08:11:28.522099 run patchelf(pid=11738): Terminated: ok {rc=0} 08:11:28.662113 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:11:28.992003 run setcap-netadm(pid=11739): Launched 08:11:30.180336 run setcap-netadm(pid=11739): Terminated: ok {rc=0} 08:11:30.525717 run srsepc(pid=11740): Launched 08:11:30.648466 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:11:31.912905 run rm-remote-dir(pid=11741): Launched 08:11:32.223936 run srsepc(pid=11740): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11740)] 08:11:32.368040 run srsepc(pid=11740): stdout: | (launched: 2022-12-09_08:11:30.465374) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:11:32.511944 run srsepc(pid=11740): stderr: | (launched: 2022-12-09_08:11:30.514423) | Connection to 10.42.42.116 closed. 08:11:32.656220 run srsepc(pid=11740): stdout: | (launched: 2022-12-09_08:11:30.465374) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:11:32.794290 run srsepc(pid=11740): stderr: | (launched: 2022-12-09_08:11:30.514423) | Connection to 10.42.42.116 closed. 08:11:32.958400 run rm-remote-dir(pid=11741): Terminating (SIGINT) 08:11:33.146631 run rm-remote-dir(pid=11741): Terminated: ok {rc=0} 08:11:33.282831 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=11740): Process ended prematurely: srsepc(pid=11740) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11740)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 08:11:33.294333 tst iperf3_dl.py:42: Test FAILED (19.2 sec) 08:11:33.374997 run scp-back-log(pid=11742): Launched 08:11:34.457827 run scp-back-log(pid=11742): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11742)] 08:11:34.521675 run scp-back-log(pid=11742): stdout: | (launched: 2022-12-09_08:11:33.343078) 08:11:34.587515 run scp-back-log(pid=11742): stderr: | (launched: 2022-12-09_08:11:33.363865) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:11:34.660802 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11742): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11742)]') ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 08:11:34.707733 tst iperf3_ul.py:13: Number of physical ue: 1 08:11:34.928522 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:11:34.972126 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 08:11:35.192406 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:11:35.209261 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:11:35.242360 tst iperf3_ul.py: using MSISDN 7113 08:11:35.360288 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7113', subscriber_id=0} 08:11:35.474886 run srsepc_10.42.42.118: Starting srsepc 08:11:36.146641 run rm-remote-dir(pid=11744): Launched 08:11:37.340149 run rm-remote-dir(pid=11744): Terminated: ok {rc=0} 08:11:37.698719 run mk-remote-dir(pid=11745): Launched 08:11:38.891882 run mk-remote-dir(pid=11745): Terminated: ok {rc=0} 08:11:39.198857 run scp-inst-to-remote(pid=11746): Launched 08:11:41.386403 run scp-inst-to-remote(pid=11746): Terminated: ok {rc=0} 08:11:41.721699 run rm-remote-dir(pid=11748): Launched 08:11:42.899430 run rm-remote-dir(pid=11748): Terminated: ok {rc=0} 08:11:43.236724 run mk-remote-dir(pid=11749): Launched 08:11:44.415912 run mk-remote-dir(pid=11749): Terminated: ok {rc=0} 08:11:44.703771 run scp-cfg-to-remote(pid=11750): Launched 08:11:45.894807 run scp-cfg-to-remote(pid=11750): Terminated: ok {rc=0} 08:11:46.196141 run scp-db-to-remote(pid=11752): Launched 08:11:47.434293 run scp-db-to-remote(pid=11752): Terminated: ok {rc=0} 08:11:47.566049 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:11:47.876481 run patchelf(pid=11754): Launched 08:11:49.053999 run patchelf(pid=11754): Terminated: ok {rc=0} 08:11:49.186468 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:11:49.498754 run setcap-netadm(pid=11755): Launched 08:11:50.675776 run setcap-netadm(pid=11755): Terminated: ok {rc=0} 08:11:51.003759 run srsepc(pid=11756): Launched 08:11:51.118447 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:11:52.230616 run rm-remote-dir(pid=11757): Launched 08:11:52.407084 run srsepc(pid=11756): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11756)] 08:11:52.541563 run srsepc(pid=11756): stdout: | (launched: 2022-12-09_08:11:50.947111) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:11:52.676678 run srsepc(pid=11756): stderr: | (launched: 2022-12-09_08:11:50.992916) | Connection to 10.42.42.116 closed. 08:11:52.811948 run srsepc(pid=11756): stdout: | (launched: 2022-12-09_08:11:50.947111) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:11:52.941600 run srsepc(pid=11756): stderr: | (launched: 2022-12-09_08:11:50.992916) | Connection to 10.42.42.116 closed. 08:11:53.095308 run rm-remote-dir(pid=11757): Terminating (SIGINT) 08:11:53.278727 run rm-remote-dir(pid=11757): Terminated: ok {rc=0} 08:11:53.416632 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=11756): Process ended prematurely: srsepc(pid=11756) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11756)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 08:11:53.426805 tst iperf3_ul.py:42: Test FAILED (18.7 sec) 08:11:53.503888 run scp-back-log(pid=11758): Launched 08:11:54.581921 run scp-back-log(pid=11758): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11758)] 08:11:54.642110 run scp-back-log(pid=11758): stdout: | (launched: 2022-12-09_08:11:53.473101) 08:11:54.704394 run scp-back-log(pid=11758): stderr: | (launched: 2022-12-09_08:11:53.492844) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:11:54.774248 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11758): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11758)]') ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 08:11:54.820083 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:11:54.836842 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:11:54.860103 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:11:54.909574 tst ping.py: using MSISDN 7114 08:11:55.025524 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7114', subscriber_id=0} 08:11:55.133939 run srsepc_10.42.42.118: Starting srsepc 08:11:55.765546 run rm-remote-dir(pid=11760): Launched 08:11:56.943781 run rm-remote-dir(pid=11760): Terminated: ok {rc=0} 08:11:57.278960 run mk-remote-dir(pid=11761): Launched 08:11:58.461934 run mk-remote-dir(pid=11761): Terminated: ok {rc=0} 08:11:58.768174 run scp-inst-to-remote(pid=11762): Launched 08:12:00.964718 run scp-inst-to-remote(pid=11762): Terminated: ok {rc=0} 08:12:01.346694 run rm-remote-dir(pid=11764): Launched 08:12:02.542367 run rm-remote-dir(pid=11764): Terminated: ok {rc=0} 08:12:02.899878 run mk-remote-dir(pid=11765): Launched 08:12:04.091294 run mk-remote-dir(pid=11765): Terminated: ok {rc=0} 08:12:04.395884 run scp-cfg-to-remote(pid=11767): Launched 08:12:05.584191 run scp-cfg-to-remote(pid=11767): Terminated: ok {rc=0} 08:12:05.886806 run scp-db-to-remote(pid=11769): Launched 08:12:07.076239 run scp-db-to-remote(pid=11769): Terminated: ok {rc=0} 08:12:07.215768 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:12:07.545865 run patchelf(pid=11771): Launched 08:12:08.734459 run patchelf(pid=11771): Terminated: ok {rc=0} 08:12:08.873997 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:12:09.204543 run setcap-netadm(pid=11772): Launched 08:12:10.392823 run setcap-netadm(pid=11772): Terminated: ok {rc=0} 08:12:10.737577 run srsepc(pid=11773): Launched 08:12:10.861595 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:12:11.985914 run rm-remote-dir(pid=11774): Launched 08:12:12.163202 run srsepc(pid=11773): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11773)] 08:12:12.298059 run srsepc(pid=11773): stdout: | (launched: 2022-12-09_08:12:10.677491) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:12:12.433301 run srsepc(pid=11773): stderr: | (launched: 2022-12-09_08:12:10.726513) | Connection to 10.42.42.116 closed. 08:12:12.567895 run srsepc(pid=11773): stdout: | (launched: 2022-12-09_08:12:10.677491) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:12:12.696612 run srsepc(pid=11773): stderr: | (launched: 2022-12-09_08:12:10.726513) | Connection to 10.42.42.116 closed. 08:12:12.849371 run rm-remote-dir(pid=11774): Terminating (SIGINT) 08:12:13.026163 run rm-remote-dir(pid=11774): Terminated: ok {rc=0} 08:12:13.154804 tst ping.py:16: ERR: Error: srsepc(pid=11773): Process ended prematurely: srsepc(pid=11773) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11773)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 08:12:13.164639 tst ping.py:16: Test FAILED (18.3 sec) 08:12:13.242282 run scp-back-log(pid=11775): Launched 08:12:14.318277 run scp-back-log(pid=11775): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11775)] 08:12:14.379036 run scp-back-log(pid=11775): stdout: | (launched: 2022-12-09_08:12:13.211273) 08:12:14.441434 run scp-back-log(pid=11775): stderr: | (launched: 2022-12-09_08:12:13.231199) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:12:14.511455 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11775): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11775)]') ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 08:12:14.556356 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:12:14.573081 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:12:14.596321 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:12:14.648400 tst rrc_idle_mo_ping.py: using MSISDN 7115 08:12:14.771216 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7115', subscriber_id=0} 08:12:14.886742 run srsepc_10.42.42.118: Starting srsepc 08:12:15.558656 run rm-remote-dir(pid=11777): Launched 08:12:16.745362 run rm-remote-dir(pid=11777): Terminated: ok {rc=0} 08:12:17.098458 run mk-remote-dir(pid=11778): Launched 08:12:18.311315 run mk-remote-dir(pid=11778): Terminated: ok {rc=0} 08:12:18.598365 run scp-inst-to-remote(pid=11779): Launched 08:12:20.773679 run scp-inst-to-remote(pid=11779): Terminated: ok {rc=0} 08:12:21.106433 run rm-remote-dir(pid=11781): Launched 08:12:22.283309 run rm-remote-dir(pid=11781): Terminated: ok {rc=0} 08:12:22.618601 run mk-remote-dir(pid=11782): Launched 08:12:23.796467 run mk-remote-dir(pid=11782): Terminated: ok {rc=0} 08:12:24.083040 run scp-cfg-to-remote(pid=11783): Launched 08:12:25.258123 run scp-cfg-to-remote(pid=11783): Terminated: ok {rc=0} 08:12:25.542439 run scp-db-to-remote(pid=11785): Launched 08:12:26.718542 run scp-db-to-remote(pid=11785): Terminated: ok {rc=0} 08:12:26.849528 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:12:27.157265 run patchelf(pid=11787): Launched 08:12:28.332826 run patchelf(pid=11787): Terminated: ok {rc=0} 08:12:28.463252 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:12:28.772187 run setcap-netadm(pid=11788): Launched 08:12:29.946114 run setcap-netadm(pid=11788): Terminated: ok {rc=0} 08:12:30.268379 run srsepc(pid=11789): Launched 08:12:30.381944 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:12:31.513067 run rm-remote-dir(pid=11790): Launched 08:12:31.791438 run srsepc(pid=11789): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11789)] 08:12:31.943664 run srsepc(pid=11789): stdout: | (launched: 2022-12-09_08:12:30.211765) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:12:32.091856 run srsepc(pid=11789): stderr: | (launched: 2022-12-09_08:12:30.257249) | Connection to 10.42.42.116 closed. 08:12:32.239992 run srsepc(pid=11789): stdout: | (launched: 2022-12-09_08:12:30.211765) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:12:32.380517 run srsepc(pid=11789): stderr: | (launched: 2022-12-09_08:12:30.257249) | Connection to 10.42.42.116 closed. 08:12:32.544470 run rm-remote-dir(pid=11790): Terminating (SIGINT) 08:12:32.732672 run rm-remote-dir(pid=11790): Terminated: ok {rc=0} 08:12:32.868849 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=11789): Process ended prematurely: srsepc(pid=11789) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11789)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 08:12:32.879717 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 08:12:32.961233 run scp-back-log(pid=11791): Launched 08:12:34.040016 run scp-back-log(pid=11791): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11791)] 08:12:34.103451 run scp-back-log(pid=11791): stdout: | (launched: 2022-12-09_08:12:32.928872) 08:12:34.168578 run scp-back-log(pid=11791): stderr: | (launched: 2022-12-09_08:12:32.949800) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:12:34.241255 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11791): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11791)]') ---------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 08:12:34.288311 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:12:34.305923 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:12:34.329756 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:12:34.380468 tst rrc_idle_mt_ping.py: using MSISDN 7116 08:12:34.502410 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7116', subscriber_id=0} 08:12:34.616721 run srsepc_10.42.42.118: Starting srsepc 08:12:35.286365 run rm-remote-dir(pid=11794): Launched 08:12:36.478203 run rm-remote-dir(pid=11794): Terminated: ok {rc=0} 08:12:36.835986 run mk-remote-dir(pid=11797): Launched 08:12:38.026910 run mk-remote-dir(pid=11797): Terminated: ok {rc=0} 08:12:38.331487 run scp-inst-to-remote(pid=11798): Launched 08:12:40.522848 run scp-inst-to-remote(pid=11798): Terminated: ok {rc=0} 08:12:40.878609 run rm-remote-dir(pid=11800): Launched 08:12:42.071033 run rm-remote-dir(pid=11800): Terminated: ok {rc=0} 08:12:42.429409 run mk-remote-dir(pid=11801): Launched 08:12:43.619887 run mk-remote-dir(pid=11801): Terminated: ok {rc=0} 08:12:43.924850 run scp-cfg-to-remote(pid=11802): Launched 08:12:45.112779 run scp-cfg-to-remote(pid=11802): Terminated: ok {rc=0} 08:12:45.415470 run scp-db-to-remote(pid=11804): Launched 08:12:46.621033 run scp-db-to-remote(pid=11804): Terminated: ok {rc=0} 08:12:46.807101 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:12:47.150834 run patchelf(pid=11806): Launched 08:12:48.362487 run patchelf(pid=11806): Terminated: ok {rc=0} 08:12:48.502996 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:12:48.833520 run setcap-netadm(pid=11807): Launched 08:12:50.021537 run setcap-netadm(pid=11807): Terminated: ok {rc=0} 08:12:50.366924 run srsepc(pid=11808): Launched 08:12:50.491328 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:12:51.608316 run rm-remote-dir(pid=11809): Launched 08:12:51.783714 run srsepc(pid=11808): ERR: Terminated: ERROR {rc=127} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11808)] 08:12:51.918260 run srsepc(pid=11808): stdout: | (launched: 2022-12-09_08:12:50.306941) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:12:52.053488 run srsepc(pid=11808): stderr: | (launched: 2022-12-09_08:12:50.355877) | Connection to 10.42.42.116 closed. 08:12:52.188284 run srsepc(pid=11808): stdout: | (launched: 2022-12-09_08:12:50.306941) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:12:52.317477 run srsepc(pid=11808): stderr: | (launched: 2022-12-09_08:12:50.355877) | Connection to 10.42.42.116 closed. 08:12:52.470823 run rm-remote-dir(pid=11809): Terminating (SIGINT) 08:12:52.647425 run rm-remote-dir(pid=11809): Terminated: ok {rc=0} 08:12:52.775765 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=11808): Process ended prematurely: srsepc(pid=11808) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11808)] [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 08:12:52.785771 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 08:12:52.862661 run scp-back-log(pid=11810): Launched 08:12:53.938790 run scp-back-log(pid=11810): ERR: Terminated: ERROR {rc=1} [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11810)] 08:12:53.999445 run scp-back-log(pid=11810): stdout: | (launched: 2022-12-09_08:12:52.831825) 08:12:54.061794 run scp-back-log(pid=11810): stderr: | (launched: 2022-12-09_08:12:52.851982) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:12:54.131794 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11810): launch_sync(): local process exited with status 1 [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11810)]') --------------------------------------------------------------------- trial-2356 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 08:12:54.261717 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:54.266703 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 08:12:54.308402 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 08:12:54.335954 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 08:12:54.392646 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 08:12:54.435306 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 08:12:54.462283 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 08:12:55.007538 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 08:12:55.013123 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:12:55.024042 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 08:12:55.066302 tst handover.py: using LAC 20109 08:12:55.188379 tst handover.py: using RAC 219 08:12:55.306351 tst handover.py: using CellId 20109 08:12:55.424760 tst handover.py: using BVCI 20110 08:12:55.535064 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 08:12:55.568784 tst handover.py: using LAC 20110 08:12:55.686623 tst handover.py: using RAC 220 08:12:55.806207 tst handover.py: using CellId 20110 08:12:55.924040 tst handover.py: using BVCI 20111 08:12:56.033836 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:12:56.044681 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:12:56.055367 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:12:56.066080 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:12:56.076749 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:12:56.087460 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 08:12:56.208854 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 08:12:56.330993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:56.847029 run create_hlr_db(pid=11816): Launched 08:12:58.025530 run create_hlr_db(pid=11816): Terminated: ok {rc=0} 08:12:58.344091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11818): Launched 08:12:58.644631 run osmo-hlr_10.42.42.2(pid=11819): Launched 08:12:58.759826 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:59.278899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11821): Launched 08:12:59.579713 run osmo-stp_10.42.42.5(pid=11822): Launched 08:12:59.694819 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:00.241864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11824): Launched 08:13:00.544576 run osmo-msc_10.42.42.6(pid=11825): Launched 08:13:00.714913 run osmo-stp_10.42.42.5(pid=11822): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11822)] 08:13:00.888009 run osmo-stp_10.42.42.5(pid=11822): stdout: | (launched: 2022-12-09_08:12:59.524332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:01.153301 run osmo-stp_10.42.42.5(pid=11822): stderr: | 20221209081259691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081259691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081259691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081259691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081259692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081259692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081259692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:01.315480 run osmo-stp_10.42.42.5(pid=11822): stdout: | (launched: 2022-12-09_08:12:59.524332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:01.437922 run osmo-stp_10.42.42.5(pid=11822): stderr: | 20221209081259691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081259691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081259691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081259691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081259692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081259692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081259692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:01.584807 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11822): Process ended prematurely: osmo-stp_10.42.42.5(pid=11822) [trial-2356↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11822)] [trial-2356↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 08:13:01.593703 tst handover.py:18: Test FAILED (6.6 sec) 08:13:01.620357 run osmo-hlr_10.42.42.2(pid=11819): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11819)] 08:13:01.668916 run osmo-hlr_10.42.42.2(pid=11819): stdout: | (launched: 2022-12-09_08:12:58.589358) 08:13:01.719073 run osmo-hlr_10.42.42.2(pid=11819): stderr: | 20221209081258760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081258760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081258760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081258760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081258760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081258760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081258772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081258780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081258780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081258780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:01.789276 run osmo-msc_10.42.42.6(pid=11825): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11825)] 08:13:01.837834 run osmo-msc_10.42.42.6(pid=11825): stdout: | (launched: 2022-12-09_08:13:00.488582) 08:13:01.887726 run osmo-msc_10.42.42.6(pid=11825): stderr: | 20221209081300819 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081300819 DLGLOBAL DEBUG validating counter group 0x7fd8adc6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081300820 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081300820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081300820 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081300820 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081300822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081300822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081300822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081300822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:01.937890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11818): Terminating (SIGTERM) 08:13:01.978623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11821): Terminating (SIGTERM) 08:13:02.019149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11824): Terminating (SIGTERM) 08:13:02.061258 --- ParallelTerminationStrategy: PID 11818 died... 08:13:02.080370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11818): Terminated: ok {rc=0} 08:13:02.126421 --- ParallelTerminationStrategy: PID 11821 died... 08:13:02.145914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11821): Terminated: ok {rc=0} 08:13:02.190217 --- ParallelTerminationStrategy: PID 11824 died... 08:13:02.209186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11824): Terminated: ok {rc=0} 08:13:02.294552 bus /sierra_3: Setting Powered False 08:13:03.391902 bus /sierra_3: Setting Powered False 08:13:04.507832 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 08:13:05.760934 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:05.766616 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 08:13:05.807871 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 08:13:05.835948 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 08:13:05.888401 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 08:13:05.930495 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 08:13:05.958511 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 08:13:06.515143 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 08:13:06.520826 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:13:06.532748 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 08:13:06.572854 tst handover.py: using LAC 20111 08:13:06.701801 tst handover.py: using RAC 221 08:13:06.827292 tst handover.py: using CellId 20111 08:13:06.953311 tst handover.py: using BVCI 20112 08:13:07.073368 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 08:13:07.107787 tst handover.py: using LAC 20112 08:13:07.233129 tst handover.py: using RAC 222 08:13:07.358683 tst handover.py: using CellId 20112 08:13:07.484229 tst handover.py: using BVCI 20113 08:13:07.602117 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:13:07.613762 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:13:07.625145 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:13:07.636931 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:13:07.648919 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:13:07.660690 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 08:13:07.781128 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 08:13:07.901332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:08.377270 run create_hlr_db(pid=11831): Launched 08:13:08.501109 bus /sierra_2: Setting Powered False 08:13:09.564722 run create_hlr_db(pid=11831): Terminated: ok {rc=0} 08:13:09.972577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11833): Launched 08:13:10.276089 run osmo-hlr_10.42.42.2(pid=11834): Launched 08:13:10.392071 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:10.904446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11836): Launched 08:13:11.207432 run osmo-stp_10.42.42.5(pid=11837): Launched 08:13:11.322360 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:11.846231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11839): Launched 08:13:12.151988 run osmo-msc_10.42.42.6(pid=11840): Launched 08:13:12.322206 run osmo-stp_10.42.42.5(pid=11837): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11837)] 08:13:12.451526 run osmo-stp_10.42.42.5(pid=11837): stdout: | (launched: 2022-12-09_08:13:11.151683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:12.580548 run osmo-stp_10.42.42.5(pid=11837): stderr: | 20221209081311319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081311319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081311319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081311320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081311320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081311320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081311320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:12.707441 run osmo-stp_10.42.42.5(pid=11837): stdout: | (launched: 2022-12-09_08:13:11.151683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:12.828039 run osmo-stp_10.42.42.5(pid=11837): stderr: | 20221209081311319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081311319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081311319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081311320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081311320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081311320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081311320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:12.973154 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11837): Process ended prematurely: osmo-stp_10.42.42.5(pid=11837) [trial-2356↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11837)] [trial-2356↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 08:13:12.981347 tst handover.py:18: Test FAILED (6.5 sec) 08:13:13.007031 run osmo-hlr_10.42.42.2(pid=11834): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11834)] 08:13:13.053873 run osmo-hlr_10.42.42.2(pid=11834): stdout: | (launched: 2022-12-09_08:13:10.220482) 08:13:13.102568 run osmo-hlr_10.42.42.2(pid=11834): stderr: | 20221209081310394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081310394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081310394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081310394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081310394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081310394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081310407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081310415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081310415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081310415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:13.170454 run osmo-msc_10.42.42.6(pid=11840): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11840)] 08:13:13.217342 run osmo-msc_10.42.42.6(pid=11840): stdout: | (launched: 2022-12-09_08:13:12.095043) 08:13:13.265729 run osmo-msc_10.42.42.6(pid=11840): stderr: | 20221209081312365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081312366 DLGLOBAL DEBUG validating counter group 0x7f2fba2b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081312366 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081312366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081312366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081312366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081312368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081312368 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081312368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081312368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:13.314577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11833): Terminating (SIGTERM) 08:13:13.353873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11836): Terminating (SIGTERM) 08:13:13.392890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11839): Terminating (SIGTERM) 08:13:13.432231 --- ParallelTerminationStrategy: PID 11833 died... 08:13:13.450974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11833): Terminated: ok {rc=0} 08:13:13.494073 --- ParallelTerminationStrategy: PID 11836 died... 08:13:13.512279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11836): Terminated: ok {rc=0} 08:13:13.555186 --- ParallelTerminationStrategy: PID 11839 died... 08:13:13.573448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11839): Terminated: ok {rc=0} 08:13:13.655967 bus /sierra_3: Setting Powered False 08:13:14.753103 bus /sierra_3: Setting Powered False 08:13:15.867512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 08:13:17.132197 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:17.138392 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:13:17.195060 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:13:17.226594 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:13:17.283141 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:13:17.341587 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:13:17.369612 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:13:17.922603 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 08:13:17.928238 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:17.939839 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:13:17.977992 tst handover.py: using LAC 20113 08:13:18.105542 tst handover.py: using RAC 223 08:13:18.224594 tst handover.py: using CellId 20113 08:13:18.342319 tst handover.py: using BVCI 20114 08:13:18.453579 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:13:18.501609 tst handover.py: using LAC 20114 08:13:18.620583 tst handover.py: using RAC 224 08:13:18.737529 tst handover.py: using CellId 20114 08:13:18.855823 tst handover.py: using BVCI 20115 08:13:18.975610 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:18.987282 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:18.998753 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:19.010230 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:19.021741 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:19.033146 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:13:19.154033 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:13:19.270778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:19.715648 run create_hlr_db(pid=11846): Launched 08:13:19.839493 bus /sierra_2: Setting Powered False 08:13:20.899089 run create_hlr_db(pid=11846): Terminated: ok {rc=0} 08:13:21.294013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Launched 08:13:21.596560 run osmo-hlr_10.42.42.2(pid=11849): Launched 08:13:21.711894 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:22.220838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Launched 08:13:22.523856 run osmo-stp_10.42.42.5(pid=11852): Launched 08:13:22.638955 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:23.162446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11854): Launched 08:13:23.465204 run osmo-msc_10.42.42.6(pid=11855): Launched 08:13:23.634186 run osmo-stp_10.42.42.5(pid=11852): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] 08:13:23.762699 run osmo-stp_10.42.42.5(pid=11852): stdout: | (launched: 2022-12-09_08:13:22.467685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:23.890131 run osmo-stp_10.42.42.5(pid=11852): stderr: | 20221209081322636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081322636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081322636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081322636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081322637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081322637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081322637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:24.016333 run osmo-stp_10.42.42.5(pid=11852): stdout: | (launched: 2022-12-09_08:13:22.467685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:24.137169 run osmo-stp_10.42.42.5(pid=11852): stderr: | 20221209081322636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081322636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081322636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081322636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081322637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081322637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081322637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:24.280724 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11852): Process ended prematurely: osmo-stp_10.42.42.5(pid=11852) [trial-2356↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] [trial-2356↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 08:13:24.288925 tst handover.py:18: Test FAILED (6.4 sec) 08:13:24.314534 run osmo-hlr_10.42.42.2(pid=11849): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11849)] 08:13:24.361529 run osmo-hlr_10.42.42.2(pid=11849): stdout: | (launched: 2022-12-09_08:13:21.540106) 08:13:24.410183 run osmo-hlr_10.42.42.2(pid=11849): stderr: | 20221209081321711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081321711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081321711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081321711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081321711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081321712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081321724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081321732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081321732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081321732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:24.478115 run osmo-msc_10.42.42.6(pid=11855): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11855)] 08:13:24.525106 run osmo-msc_10.42.42.6(pid=11855): stdout: | (launched: 2022-12-09_08:13:23.409378) 08:13:24.573415 run osmo-msc_10.42.42.6(pid=11855): stderr: | 20221209081323678 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081323678 DLGLOBAL DEBUG validating counter group 0x7f5dce48cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081323679 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081323679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081323679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081323679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081323681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081323681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081323681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081323681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:24.622335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Terminating (SIGTERM) 08:13:24.661298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Terminating (SIGTERM) 08:13:24.700300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11854): Terminating (SIGTERM) 08:13:24.739491 --- ParallelTerminationStrategy: PID 11848 died... 08:13:24.758223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Terminated: ok {rc=0} 08:13:24.801987 --- ParallelTerminationStrategy: PID 11851 died... 08:13:24.820280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Terminated: ok {rc=0} 08:13:24.863408 --- ParallelTerminationStrategy: PID 11854 died... 08:13:24.881743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11854): Terminated: ok {rc=0} 08:13:24.964429 bus /sierra_3: Setting Powered False 08:13:26.061303 bus /sierra_3: Setting Powered False 08:13:27.179020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:13:28.441310 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:28.446287 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:13:28.495990 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:13:28.522738 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:13:28.572856 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:13:28.622207 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:13:28.648593 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:13:29.204872 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:13:29.210084 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:13:29.221363 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:13:29.259396 tst handover.py: using LAC 20115 08:13:29.378356 tst handover.py: using RAC 225 08:13:29.496887 tst handover.py: using CellId 20115 08:13:29.613493 tst handover.py: using BVCI 20116 08:13:29.724675 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:13:29.768563 tst handover.py: using LAC 20116 08:13:29.885525 tst handover.py: using RAC 226 08:13:30.015322 tst handover.py: using CellId 20116 08:13:30.140652 tst handover.py: using BVCI 20117 08:13:30.259250 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:13:30.270936 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:13:30.282456 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:13:30.294150 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:13:30.305783 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:13:30.317418 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:13:30.434657 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:13:30.555282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:31.057225 run create_hlr_db(pid=11860): Launched 08:13:31.221006 bus /sierra_2: Setting Powered False 08:13:32.282212 run create_hlr_db(pid=11860): Terminated: ok {rc=0} 08:13:32.696595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11862): Launched 08:13:33.021381 run osmo-hlr_10.42.42.2(pid=11863): Launched 08:13:33.145439 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:33.677690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11865): Launched 08:13:34.002330 run osmo-stp_10.42.42.5(pid=11866): Launched 08:13:34.126871 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:34.694007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11868): Launched 08:13:35.022018 run osmo-msc_10.42.42.6(pid=11869): Launched 08:13:35.204029 run osmo-stp_10.42.42.5(pid=11866): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11866)] 08:13:35.341778 run osmo-stp_10.42.42.5(pid=11866): stdout: | (launched: 2022-12-09_08:13:33.942426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:35.480054 run osmo-stp_10.42.42.5(pid=11866): stderr: | 20221209081334131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081334131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081334131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081334132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081334132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081334132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081334132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:35.617484 run osmo-stp_10.42.42.5(pid=11866): stdout: | (launched: 2022-12-09_08:13:33.942426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:35.747076 run osmo-stp_10.42.42.5(pid=11866): stderr: | 20221209081334131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081334131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081334131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081334132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081334132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081334132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081334132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:35.902123 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11866): Process ended prematurely: osmo-stp_10.42.42.5(pid=11866) [trial-2356↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11866)] [trial-2356↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 08:13:35.911277 tst handover.py:18: Test FAILED (6.7 sec) 08:13:35.938968 run osmo-hlr_10.42.42.2(pid=11863): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11863)] 08:13:35.989793 run osmo-hlr_10.42.42.2(pid=11863): stdout: | (launched: 2022-12-09_08:13:32.961659) 08:13:36.041608 run osmo-hlr_10.42.42.2(pid=11863): stderr: | 20221209081333155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081333155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081333155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081333155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081333155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081333155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081333167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081333176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081333176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081333176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:36.113452 run osmo-msc_10.42.42.6(pid=11869): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11869)] 08:13:36.163673 run osmo-msc_10.42.42.6(pid=11869): stdout: | (launched: 2022-12-09_08:13:34.962181) 08:13:36.215110 run osmo-msc_10.42.42.6(pid=11869): stderr: | 20221209081335279 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081335280 DLGLOBAL DEBUG validating counter group 0x7f7cda6d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081335280 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081335280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081335280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081335280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081335282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081335282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081335282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081335282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:36.267069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11862): Terminating (SIGTERM) 08:13:36.308876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11865): Terminating (SIGTERM) 08:13:36.350682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11868): Terminating (SIGTERM) 08:13:36.392564 --- ParallelTerminationStrategy: PID 11862 died... 08:13:36.412056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11862): Terminated: ok {rc=0} 08:13:36.458596 --- ParallelTerminationStrategy: PID 11865 died... 08:13:36.478366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11865): Terminated: ok {rc=0} 08:13:36.524326 --- ParallelTerminationStrategy: PID 11868 died... 08:13:36.543913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11868): Terminated: ok {rc=0} 08:13:36.632078 bus /sierra_3: Setting Powered False 08:13:37.729579 bus /sierra_3: Setting Powered False 08:13:38.845425 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:13:40.106481 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:40.112230 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:13:40.168766 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:13:40.196601 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:13:40.251197 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:13:40.307937 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:13:40.335416 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:13:40.889546 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:13:40.895099 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:40.906778 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:13:40.945282 tst handover.py: using LAC 20117 08:13:41.074302 tst handover.py: using RAC 227 08:13:41.202167 tst handover.py: using CellId 20117 08:13:41.328700 tst handover.py: using BVCI 20118 08:13:41.446358 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:13:41.496809 tst handover.py: using LAC 20118 08:13:41.625278 tst handover.py: using RAC 228 08:13:41.753701 tst handover.py: using CellId 20118 08:13:41.880755 tst handover.py: using BVCI 20119 08:13:42.001282 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:42.012907 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:42.024422 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:42.036011 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:42.047580 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:42.059178 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:13:42.177278 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:13:42.297630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:42.774084 run create_hlr_db(pid=11874): Launched 08:13:42.899362 bus /sierra_2: Setting Powered False 08:13:43.963079 run create_hlr_db(pid=11874): Terminated: ok {rc=0} 08:13:44.385272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11876): Launched 08:13:44.708538 run osmo-hlr_10.42.42.2(pid=11877): Launched 08:13:44.832691 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:45.363399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11879): Launched 08:13:45.688218 run osmo-stp_10.42.42.5(pid=11880): Launched 08:13:45.812089 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:46.466767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11882): Launched 08:13:46.809855 run osmo-msc_10.42.42.6(pid=11883): Launched 08:13:47.228261 run osmo-stp_10.42.42.5(pid=11880): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11880)] 08:13:47.405501 run osmo-stp_10.42.42.5(pid=11880): stdout: | (launched: 2022-12-09_08:13:45.628855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:47.544934 run osmo-stp_10.42.42.5(pid=11880): stderr: | 20221209081345818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081345818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081345818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081345819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081345819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081345819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081345819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:47.680375 run osmo-stp_10.42.42.5(pid=11880): stdout: | (launched: 2022-12-09_08:13:45.628855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:47.809486 run osmo-stp_10.42.42.5(pid=11880): stderr: | 20221209081345818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081345818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081345818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081345819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081345819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081345819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081345819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:47.964364 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11880): Process ended prematurely: osmo-stp_10.42.42.5(pid=11880) [trial-2356↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11880)] [trial-2356↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 08:13:47.973436 tst handover.py:18: Test FAILED (7.1 sec) 08:13:48.000801 run osmo-hlr_10.42.42.2(pid=11877): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11877)] 08:13:48.050684 run osmo-hlr_10.42.42.2(pid=11877): stdout: | (launched: 2022-12-09_08:13:44.649338) 08:13:48.102805 run osmo-hlr_10.42.42.2(pid=11877): stderr: | 20221209081344845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081344845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081344845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081344845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081344845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081344845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081344857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081344866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081344866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081344866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:48.174812 run osmo-msc_10.42.42.6(pid=11883): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11883)] 08:13:48.225186 run osmo-msc_10.42.42.6(pid=11883): stdout: | (launched: 2022-12-09_08:13:46.748428) 08:13:48.276658 run osmo-msc_10.42.42.6(pid=11883): stderr: | 20221209081347316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081347316 DLGLOBAL DEBUG validating counter group 0x7f9592b3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081347316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081347316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081347316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081347316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081347322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081347323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081347323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081347323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:48.328598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11876): Terminating (SIGTERM) 08:13:48.370002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11879): Terminating (SIGTERM) 08:13:48.411766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11882): Terminating (SIGTERM) 08:13:48.453707 --- ParallelTerminationStrategy: PID 11876 died... 08:13:48.473899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11876): Terminated: ok {rc=0} 08:13:48.520020 --- ParallelTerminationStrategy: PID 11879 died... 08:13:48.539791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11879): Terminated: ok {rc=0} 08:13:48.586129 --- ParallelTerminationStrategy: PID 11882 died... 08:13:48.605445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11882): Terminated: ok {rc=0} 08:13:48.693509 bus /sierra_3: Setting Powered False 08:13:49.790014 bus /sierra_3: Setting Powered False 08:13:50.904509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 08:13:52.169468 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:52.175073 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:13:52.217841 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:13:52.246855 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:13:52.300026 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:13:52.343691 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:13:52.371276 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:13:52.923905 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 08:13:52.929615 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:52.941375 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 08:13:52.979200 tst handover.py: using LAC 20119 08:13:53.107479 tst handover.py: using RAC 229 08:13:53.236031 tst handover.py: using CellId 20119 08:13:53.364167 tst handover.py: using BVCI 20120 08:13:53.474580 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 08:13:53.509376 tst handover.py: using LAC 20120 08:13:53.629195 tst handover.py: using RAC 230 08:13:53.756893 tst handover.py: using CellId 20120 08:13:53.883978 tst handover.py: using BVCI 20121 08:13:54.004200 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:54.015764 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:54.027154 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:54.038590 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:54.050011 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:54.061173 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 08:13:54.178297 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 08:13:54.298392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:54.777181 run create_hlr_db(pid=11888): Launched 08:13:54.900727 bus /sierra_2: Setting Powered False 08:13:55.964927 run create_hlr_db(pid=11888): Terminated: ok {rc=0} 08:13:56.372370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11890): Launched 08:13:56.673951 run osmo-hlr_10.42.42.2(pid=11891): Launched 08:13:56.788596 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:57.297577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11893): Launched 08:13:57.600791 run osmo-stp_10.42.42.5(pid=11894): Launched 08:13:57.715968 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:58.238487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11896): Launched 08:13:58.542644 run osmo-msc_10.42.42.6(pid=11897): Launched 08:13:58.712016 run osmo-stp_10.42.42.5(pid=11894): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11894)] 08:13:58.840289 run osmo-stp_10.42.42.5(pid=11894): stdout: | (launched: 2022-12-09_08:13:57.544690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:58.968764 run osmo-stp_10.42.42.5(pid=11894): stderr: | 20221209081357711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081357711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081357711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081357712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081357712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081357712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081357712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:59.095347 run osmo-stp_10.42.42.5(pid=11894): stdout: | (launched: 2022-12-09_08:13:57.544690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:59.215480 run osmo-stp_10.42.42.5(pid=11894): stderr: | 20221209081357711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081357711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081357711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081357712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081357712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081357712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081357712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:59.359400 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11894): Process ended prematurely: osmo-stp_10.42.42.5(pid=11894) [trial-2356↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11894)] [trial-2356↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 08:13:59.367653 tst handover.py:18: Test FAILED (6.4 sec) 08:13:59.393269 run osmo-hlr_10.42.42.2(pid=11891): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11891)] 08:13:59.440239 run osmo-hlr_10.42.42.2(pid=11891): stdout: | (launched: 2022-12-09_08:13:56.617957) 08:13:59.489008 run osmo-hlr_10.42.42.2(pid=11891): stderr: | 20221209081356787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081356787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081356787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081356787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081356787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081356787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081356801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081356809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081356809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081356809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:59.557130 run osmo-msc_10.42.42.6(pid=11897): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11897)] 08:13:59.603964 run osmo-msc_10.42.42.6(pid=11897): stdout: | (launched: 2022-12-09_08:13:58.486608) 08:13:59.652411 run osmo-msc_10.42.42.6(pid=11897): stderr: | 20221209081358754 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081358755 DLGLOBAL DEBUG validating counter group 0x7fc83232fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081358755 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081358755 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081358755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081358755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081358757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081358757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081358757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081358757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:59.701472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11890): Terminating (SIGTERM) 08:13:59.740309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11893): Terminating (SIGTERM) 08:13:59.779194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11896): Terminating (SIGTERM) 08:13:59.818472 --- ParallelTerminationStrategy: PID 11890 died... 08:13:59.837394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11890): Terminated: ok {rc=0} 08:13:59.880679 --- ParallelTerminationStrategy: PID 11893 died... 08:13:59.899001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11893): Terminated: ok {rc=0} 08:13:59.942071 --- ParallelTerminationStrategy: PID 11896 died... 08:13:59.960229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11896): Terminated: ok {rc=0} 08:14:00.046044 bus /sierra_3: Setting Powered False 08:14:01.149212 bus /sierra_3: Setting Powered False 08:14:02.270857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 08:14:03.514214 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:03.519615 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:14:03.573231 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:14:03.600053 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:14:03.651366 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:14:03.704516 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:14:03.731059 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:14:04.284145 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 08:14:04.289371 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:04.300165 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:14:04.336816 tst handover.py: using LAC 20121 08:14:04.467502 tst handover.py: using RAC 231 08:14:04.596615 tst handover.py: using CellId 20121 08:14:04.715723 tst handover.py: using BVCI 20122 08:14:04.827681 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:14:04.876595 tst handover.py: using LAC 20122 08:14:04.996569 tst handover.py: using RAC 232 08:14:05.124129 tst handover.py: using CellId 20122 08:14:05.252770 tst handover.py: using BVCI 20123 08:14:05.371127 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:05.382757 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:05.394266 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:05.405666 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:05.416935 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:05.428135 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:14:05.543642 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:14:05.663801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:06.142342 run create_hlr_db(pid=11903): Launched 08:14:06.266253 bus /sierra_2: Setting Powered False 08:14:07.330557 run create_hlr_db(pid=11903): Terminated: ok {rc=0} 08:14:07.752391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11905): Launched 08:14:08.077824 run osmo-hlr_10.42.42.2(pid=11906): Launched 08:14:08.203270 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:08.741332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11908): Launched 08:14:09.066234 run osmo-stp_10.42.42.5(pid=11909): Launched 08:14:09.190425 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:09.751068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11911): Launched 08:14:10.076630 run osmo-msc_10.42.42.6(pid=11912): Launched 08:14:10.257895 run osmo-stp_10.42.42.5(pid=11909): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11909)] 08:14:10.394282 run osmo-stp_10.42.42.5(pid=11909): stdout: | (launched: 2022-12-09_08:14:09.006367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:10.531809 run osmo-stp_10.42.42.5(pid=11909): stderr: | 20221209081409195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081409195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081409195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081409196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081409196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081409196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081409196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:10.668049 run osmo-stp_10.42.42.5(pid=11909): stdout: | (launched: 2022-12-09_08:14:09.006367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:10.797338 run osmo-stp_10.42.42.5(pid=11909): stderr: | 20221209081409195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081409195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081409195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081409196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081409196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081409196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081409196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:10.952622 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11909): Process ended prematurely: osmo-stp_10.42.42.5(pid=11909) [trial-2356↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11909)] [trial-2356↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 08:14:10.961951 tst handover.py:18: Test FAILED (6.7 sec) 08:14:10.989283 run osmo-hlr_10.42.42.2(pid=11906): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11906)] 08:14:11.038946 run osmo-hlr_10.42.42.2(pid=11906): stdout: | (launched: 2022-12-09_08:14:08.018310) 08:14:11.090141 run osmo-hlr_10.42.42.2(pid=11906): stderr: | 20221209081408213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081408213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081408213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081408213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081408213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081408214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081408226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081408234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081408235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081408235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:11.162436 run osmo-msc_10.42.42.6(pid=11912): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11912)] 08:14:11.212425 run osmo-msc_10.42.42.6(pid=11912): stdout: | (launched: 2022-12-09_08:14:10.017297) 08:14:11.264184 run osmo-msc_10.42.42.6(pid=11912): stderr: | 20221209081410336 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081410337 DLGLOBAL DEBUG validating counter group 0x7f9474c61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081410337 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081410337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081410337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081410337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081410339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081410339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081410339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081410340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:11.316078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11905): Terminating (SIGTERM) 08:14:11.357877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11908): Terminating (SIGTERM) 08:14:11.399461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11911): Terminating (SIGTERM) 08:14:11.441751 --- ParallelTerminationStrategy: PID 11905 died... 08:14:11.461631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11905): Terminated: ok {rc=0} 08:14:11.507807 --- ParallelTerminationStrategy: PID 11908 died... 08:14:11.527552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11908): Terminated: ok {rc=0} 08:14:11.573611 --- ParallelTerminationStrategy: PID 11911 died... 08:14:11.593485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11911): Terminated: ok {rc=0} 08:14:11.682155 bus /sierra_3: Setting Powered False 08:14:12.781449 bus /sierra_3: Setting Powered False 08:14:13.898795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 08:14:15.169616 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:15.176566 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:14:15.231427 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:14:15.259910 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:14:15.311650 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:14:15.366797 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:14:15.394403 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:14:15.963571 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 08:14:15.973930 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:15.986150 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:14:16.027783 tst handover.py: using LAC 20123 08:14:16.158147 tst handover.py: using RAC 233 08:14:16.325315 tst handover.py: using CellId 20123 08:14:16.457152 tst handover.py: using BVCI 20124 08:14:16.579341 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:14:16.627638 tst handover.py: using LAC 20124 08:14:16.771890 tst handover.py: using RAC 234 08:14:16.934220 tst handover.py: using CellId 20124 08:14:17.092168 tst handover.py: using BVCI 20125 08:14:17.244680 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:17.259916 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:17.275122 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:17.290648 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:17.302334 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:17.314303 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:14:17.436622 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:14:17.558459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:18.005869 run create_hlr_db(pid=11917): Launched 08:14:18.129426 bus /sierra_2: Setting Powered False 08:14:19.189665 run create_hlr_db(pid=11917): Terminated: ok {rc=0} 08:14:19.586447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11919): Launched 08:14:19.888926 run osmo-hlr_10.42.42.2(pid=11920): Launched 08:14:20.003711 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:20.498300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11922): Launched 08:14:20.800909 run osmo-stp_10.42.42.5(pid=11923): Launched 08:14:20.916733 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:21.438874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11925): Launched 08:14:21.741533 run osmo-msc_10.42.42.6(pid=11926): Launched 08:14:21.910240 run osmo-stp_10.42.42.5(pid=11923): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11923)] 08:14:22.041842 run osmo-stp_10.42.42.5(pid=11923): stdout: | (launched: 2022-12-09_08:14:20.744937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:22.169671 run osmo-stp_10.42.42.5(pid=11923): stderr: | 20221209081420910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081420911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081420911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081420911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081420912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081420912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081420912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:22.295764 run osmo-stp_10.42.42.5(pid=11923): stdout: | (launched: 2022-12-09_08:14:20.744937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:22.415582 run osmo-stp_10.42.42.5(pid=11923): stderr: | 20221209081420910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081420911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081420911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081420911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081420912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081420912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081420912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:22.559880 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11923): Process ended prematurely: osmo-stp_10.42.42.5(pid=11923) [trial-2356↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11923)] [trial-2356↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 08:14:22.568226 tst handover.py:18: Test FAILED (6.6 sec) 08:14:22.593943 run osmo-hlr_10.42.42.2(pid=11920): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11920)] 08:14:22.640898 run osmo-hlr_10.42.42.2(pid=11920): stdout: | (launched: 2022-12-09_08:14:19.833267) 08:14:22.689789 run osmo-hlr_10.42.42.2(pid=11920): stderr: | 20221209081420006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081420006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081420006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081420006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081420006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081420006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081420018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081420027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081420028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081420028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:22.757971 run osmo-msc_10.42.42.6(pid=11926): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11926)] 08:14:22.805080 run osmo-msc_10.42.42.6(pid=11926): stdout: | (launched: 2022-12-09_08:14:21.685637) 08:14:22.853758 run osmo-msc_10.42.42.6(pid=11926): stderr: | 20221209081421955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081421955 DLGLOBAL DEBUG validating counter group 0x7fd642ad4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081421955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081421955 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081421956 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081421956 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081421957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081421958 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081421958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081421958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:22.902759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11919): Terminating (SIGTERM) 08:14:22.941761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11922): Terminating (SIGTERM) 08:14:22.980753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11925): Terminating (SIGTERM) 08:14:23.020167 --- ParallelTerminationStrategy: PID 11919 died... 08:14:23.039120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11919): Terminated: ok {rc=0} 08:14:23.082493 --- ParallelTerminationStrategy: PID 11922 died... 08:14:23.100841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11922): Terminated: ok {rc=0} 08:14:23.144287 --- ParallelTerminationStrategy: PID 11925 died... 08:14:23.162753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11925): Terminated: ok {rc=0} 08:14:23.245371 bus /sierra_3: Setting Powered False 08:14:24.343771 bus /sierra_3: Setting Powered False 08:14:25.459944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 08:14:26.722584 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:26.728000 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 08:14:26.765773 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 08:14:26.793408 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 08:14:26.850083 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 08:14:26.888577 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 08:14:26.916574 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 08:14:27.464309 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 08:14:27.470068 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:14:27.481364 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 08:14:27.516582 tst handover.py: using LAC 20125 08:14:27.645289 tst handover.py: using RAC 235 08:14:27.777357 tst handover.py: using CellId 20125 08:14:27.904075 tst handover.py: using BVCI 20126 08:14:28.022332 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 08:14:28.056540 tst handover.py: using LAC 20126 08:14:28.185385 tst handover.py: using RAC 236 08:14:28.311089 tst handover.py: using CellId 20126 08:14:28.438597 tst handover.py: using BVCI 20127 08:14:28.557134 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:14:28.568491 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:14:28.579614 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:14:28.590685 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:14:28.601832 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:14:28.612929 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 08:14:28.730249 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 08:14:28.847441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:29.294015 run create_hlr_db(pid=11931): Launched 08:14:29.419419 bus /sierra_2: Setting Powered False 08:14:30.479411 run create_hlr_db(pid=11931): Terminated: ok {rc=0} 08:14:30.916878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11933): Launched 08:14:31.245437 run osmo-hlr_10.42.42.2(pid=11934): Launched 08:14:31.412071 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:32.118479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11936): Launched 08:14:32.441180 run osmo-stp_10.42.42.5(pid=11937): Launched 08:14:32.557413 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:33.080650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11939): Launched 08:14:33.387196 run osmo-msc_10.42.42.6(pid=11940): Launched 08:14:33.556705 run osmo-stp_10.42.42.5(pid=11937): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11937)] 08:14:33.684601 run osmo-stp_10.42.42.5(pid=11937): stdout: | (launched: 2022-12-09_08:14:32.384520) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:33.812703 run osmo-stp_10.42.42.5(pid=11937): stderr: | 20221209081432551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081432552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081432552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081432552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081432553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081432553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081432553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:33.939474 run osmo-stp_10.42.42.5(pid=11937): stdout: | (launched: 2022-12-09_08:14:32.384520) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:34.059658 run osmo-stp_10.42.42.5(pid=11937): stderr: | 20221209081432551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081432552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081432552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081432552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081432553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081432553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081432553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:34.203760 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11937): Process ended prematurely: osmo-stp_10.42.42.5(pid=11937) [trial-2356↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11937)] [trial-2356↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 08:14:34.212111 tst handover.py:18: Test FAILED (6.7 sec) 08:14:34.237805 run osmo-hlr_10.42.42.2(pid=11934): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11934)] 08:14:34.284750 run osmo-hlr_10.42.42.2(pid=11934): stdout: | (launched: 2022-12-09_08:14:31.187058) 08:14:34.333396 run osmo-hlr_10.42.42.2(pid=11934): stderr: | 20221209081431626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081431626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081431626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081431626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081431626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081431626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081431639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081431655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081431656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081431656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:34.401368 run osmo-msc_10.42.42.6(pid=11940): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11940)] 08:14:34.448214 run osmo-msc_10.42.42.6(pid=11940): stdout: | (launched: 2022-12-09_08:14:33.330390) 08:14:34.496567 run osmo-msc_10.42.42.6(pid=11940): stderr: | 20221209081433599 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081433600 DLGLOBAL DEBUG validating counter group 0x7fce58124c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081433600 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081433600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081433600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081433600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081433602 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081433602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081433603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081433603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:34.545218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11933): Terminating (SIGTERM) 08:14:34.584659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11936): Terminating (SIGTERM) 08:14:34.623695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11939): Terminating (SIGTERM) 08:14:34.662913 --- ParallelTerminationStrategy: PID 11933 died... 08:14:34.681789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11933): Terminated: ok {rc=0} 08:14:34.725071 --- ParallelTerminationStrategy: PID 11936 died... 08:14:34.743335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11936): Terminated: ok {rc=0} 08:14:34.786566 --- ParallelTerminationStrategy: PID 11939 died... 08:14:34.804866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11939): Terminated: ok {rc=0} 08:14:34.887933 bus /sierra_3: Setting Powered False 08:14:35.985207 bus /sierra_3: Setting Powered False 08:14:37.100765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 08:14:38.336553 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:38.341544 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:14:38.392268 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:14:38.419046 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:14:38.471380 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:14:38.521680 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:14:38.548132 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:14:39.099168 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 08:14:39.104126 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:14:39.115106 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:14:39.149041 tst handover.py: using LAC 20127 08:14:39.271203 tst handover.py: using RAC 237 08:14:39.399984 tst handover.py: using CellId 20127 08:14:39.526000 tst handover.py: using BVCI 20128 08:14:39.643939 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:14:39.692647 tst handover.py: using LAC 20128 08:14:39.818165 tst handover.py: using RAC 238 08:14:39.943758 tst handover.py: using CellId 20128 08:14:40.072026 tst handover.py: using BVCI 20129 08:14:40.189492 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:14:40.201282 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:14:40.212620 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:14:40.223921 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:14:40.235382 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:14:40.246668 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:14:40.362813 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:14:40.482763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:40.962066 run create_hlr_db(pid=11945): Launched 08:14:41.085482 bus /sierra_2: Setting Powered False 08:14:42.150059 run create_hlr_db(pid=11945): Terminated: ok {rc=0} 08:14:42.574682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11947): Launched 08:14:42.902033 run osmo-hlr_10.42.42.2(pid=11948): Launched 08:14:43.029106 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:43.563156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11950): Launched 08:14:43.888694 run osmo-stp_10.42.42.5(pid=11951): Launched 08:14:44.013527 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:44.573095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11953): Launched 08:14:44.898499 run osmo-msc_10.42.42.6(pid=11954): Launched 08:14:45.080730 run osmo-stp_10.42.42.5(pid=11951): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11951)] 08:14:45.218082 run osmo-stp_10.42.42.5(pid=11951): stdout: | (launched: 2022-12-09_08:14:43.828871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:45.356069 run osmo-stp_10.42.42.5(pid=11951): stderr: | 20221209081444017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081444017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081444018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081444018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081444018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081444018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081444019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:45.491729 run osmo-stp_10.42.42.5(pid=11951): stdout: | (launched: 2022-12-09_08:14:43.828871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:45.621117 run osmo-stp_10.42.42.5(pid=11951): stderr: | 20221209081444017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081444017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081444018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081444018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081444018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081444018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081444019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:45.775472 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11951): Process ended prematurely: osmo-stp_10.42.42.5(pid=11951) [trial-2356↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11951)] [trial-2356↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 08:14:45.784553 tst handover.py:18: Test FAILED (6.7 sec) 08:14:45.812179 run osmo-hlr_10.42.42.2(pid=11948): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11948)] 08:14:45.883193 run osmo-hlr_10.42.42.2(pid=11948): stdout: | (launched: 2022-12-09_08:14:42.842608) 08:14:45.942382 run osmo-hlr_10.42.42.2(pid=11948): stderr: | 20221209081443037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081443037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081443037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081443037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081443037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081443037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081443049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081443058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081443058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081443058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:46.016630 run osmo-msc_10.42.42.6(pid=11954): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11954)] 08:14:46.068676 run osmo-msc_10.42.42.6(pid=11954): stdout: | (launched: 2022-12-09_08:14:44.839131) 08:14:46.122369 run osmo-msc_10.42.42.6(pid=11954): stderr: | 20221209081445155 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081445156 DLGLOBAL DEBUG validating counter group 0x7f446fd7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081445156 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081445156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081445156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081445156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081445158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081445158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081445158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081445158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:46.176235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11947): Terminating (SIGTERM) 08:14:46.220214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11950): Terminating (SIGTERM) 08:14:46.265005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11953): Terminating (SIGTERM) 08:14:46.309133 --- ParallelTerminationStrategy: PID 11947 died... 08:14:46.329543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11947): Terminated: ok {rc=0} 08:14:46.378982 --- ParallelTerminationStrategy: PID 11950 died... 08:14:46.399222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11950): Terminated: ok {rc=0} 08:14:46.447275 --- ParallelTerminationStrategy: PID 11953 died... 08:14:46.467808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11953): Terminated: ok {rc=0} 08:14:46.561900 bus /sierra_3: Setting Powered False 08:14:47.670818 bus /sierra_3: Setting Powered False 08:14:48.784676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:14:50.044185 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:50.050020 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:14:50.098134 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:14:50.127020 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:14:50.181185 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:14:50.228584 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:14:50.255735 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:14:50.808238 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:14:50.813615 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:50.824787 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:14:50.859338 tst handover.py: using LAC 20129 08:14:50.985462 tst handover.py: using RAC 239 08:14:51.105734 tst handover.py: using CellId 20129 08:14:51.227448 tst handover.py: using BVCI 20130 08:14:51.339632 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:14:51.382876 tst handover.py: using LAC 20130 08:14:51.502286 tst handover.py: using RAC 240 08:14:51.621745 tst handover.py: using CellId 20130 08:14:51.740528 tst handover.py: using BVCI 20131 08:14:51.850914 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:51.862088 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:51.872836 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:51.883842 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:51.894753 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:51.905596 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:14:52.021870 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:14:52.142357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:52.620051 run create_hlr_db(pid=11959): Launched 08:14:52.744080 bus /sierra_2: Setting Powered False 08:14:53.809107 run create_hlr_db(pid=11959): Terminated: ok {rc=0} 08:14:54.233273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11961): Launched 08:14:54.559099 run osmo-hlr_10.42.42.2(pid=11962): Launched 08:14:54.683676 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:55.218684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11964): Launched 08:14:55.545175 run osmo-stp_10.42.42.5(pid=11965): Launched 08:14:55.671384 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:56.232814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11967): Launched 08:14:56.559815 run osmo-msc_10.42.42.6(pid=11968): Launched 08:14:56.743376 run osmo-stp_10.42.42.5(pid=11965): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11965)] 08:14:56.881782 run osmo-stp_10.42.42.5(pid=11965): stdout: | (launched: 2022-12-09_08:14:55.485688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:57.021539 run osmo-stp_10.42.42.5(pid=11965): stderr: | 20221209081455675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081455675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081455675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081455675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081455676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081455676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081455676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:57.158561 run osmo-stp_10.42.42.5(pid=11965): stdout: | (launched: 2022-12-09_08:14:55.485688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:57.288561 run osmo-stp_10.42.42.5(pid=11965): stderr: | 20221209081455675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081455675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081455675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081455675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081455676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081455676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081455676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:57.444325 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11965): Process ended prematurely: osmo-stp_10.42.42.5(pid=11965) [trial-2356↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11965)] [trial-2356↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 08:14:57.453480 tst handover.py:18: Test FAILED (6.6 sec) 08:14:57.480641 run osmo-hlr_10.42.42.2(pid=11962): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11962)] 08:14:57.530238 run osmo-hlr_10.42.42.2(pid=11962): stdout: | (launched: 2022-12-09_08:14:54.499010) 08:14:57.582938 run osmo-hlr_10.42.42.2(pid=11962): stderr: | 20221209081454694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081454694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081454694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081454694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081454694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081454694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081454704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081454713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081454713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081454713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:57.655075 run osmo-msc_10.42.42.6(pid=11968): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11968)] 08:14:57.704733 run osmo-msc_10.42.42.6(pid=11968): stdout: | (launched: 2022-12-09_08:14:56.499843) 08:14:57.756195 run osmo-msc_10.42.42.6(pid=11968): stderr: | 20221209081456818 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081456818 DLGLOBAL DEBUG validating counter group 0x7f89c65a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081456818 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081456818 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081456818 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081456819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081456820 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081456821 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081456821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081456821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:57.808073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11961): Terminating (SIGTERM) 08:14:57.849556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11964): Terminating (SIGTERM) 08:14:57.891077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11967): Terminating (SIGTERM) 08:14:57.932809 --- ParallelTerminationStrategy: PID 11961 died... 08:14:57.952585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11961): Terminated: ok {rc=0} 08:14:57.998703 --- ParallelTerminationStrategy: PID 11964 died... 08:14:58.018364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11964): Terminated: ok {rc=0} 08:14:58.064059 --- ParallelTerminationStrategy: PID 11967 died... 08:14:58.083619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11967): Terminated: ok {rc=0} 08:14:58.171392 bus /sierra_3: Setting Powered False 08:14:59.267946 bus /sierra_3: Setting Powered False 08:15:00.386107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:15:01.650496 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:01.656372 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:15:01.709009 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:15:01.736924 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:15:01.805747 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:15:01.881503 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:15:01.918347 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:15:02.471505 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:15:02.478554 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:02.491404 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:02.528408 tst handover.py: using LAC 20131 08:15:02.658696 tst handover.py: using RAC 241 08:15:02.779359 tst handover.py: using CellId 20131 08:15:02.909318 tst handover.py: using BVCI 20132 08:15:03.030704 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:03.081287 tst handover.py: using LAC 20132 08:15:03.209643 tst handover.py: using RAC 242 08:15:03.337361 tst handover.py: using CellId 20132 08:15:03.464695 tst handover.py: using BVCI 20133 08:15:03.583382 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:03.595213 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:03.606838 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:03.618466 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:03.630211 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:03.642244 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:03.759843 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:03.881128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:04.359230 run create_hlr_db(pid=11983): Launched 08:15:04.483043 bus /sierra_2: Setting Powered False 08:15:05.546622 run create_hlr_db(pid=11983): Terminated: ok {rc=0} 08:15:05.954651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11985): Launched 08:15:06.260783 run osmo-hlr_10.42.42.2(pid=11986): Launched 08:15:06.378726 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:06.875833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11988): Launched 08:15:07.178913 run osmo-stp_10.42.42.5(pid=11989): Launched 08:15:07.294929 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:07.818977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11991): Launched 08:15:08.123170 run osmo-msc_10.42.42.6(pid=11992): Launched 08:15:08.294881 run osmo-stp_10.42.42.5(pid=11989): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11989)] 08:15:08.423127 run osmo-stp_10.42.42.5(pid=11989): stdout: | (launched: 2022-12-09_08:15:07.122930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:08.551071 run osmo-stp_10.42.42.5(pid=11989): stderr: | 20221209081507290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081507290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081507291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081507291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081507292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081507292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081507292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:08.678033 run osmo-stp_10.42.42.5(pid=11989): stdout: | (launched: 2022-12-09_08:15:07.122930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:08.798660 run osmo-stp_10.42.42.5(pid=11989): stderr: | 20221209081507290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081507290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081507291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081507291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081507292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081507292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081507292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:08.943354 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11989): Process ended prematurely: osmo-stp_10.42.42.5(pid=11989) [trial-2356↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11989)] [trial-2356↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 08:15:08.951696 tst handover.py:18: Test FAILED (6.5 sec) 08:15:08.977629 run osmo-hlr_10.42.42.2(pid=11986): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11986)] 08:15:09.024690 run osmo-hlr_10.42.42.2(pid=11986): stdout: | (launched: 2022-12-09_08:15:06.204718) 08:15:09.073591 run osmo-hlr_10.42.42.2(pid=11986): stderr: | 20221209081506376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081506376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081506376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081506376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081506376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081506376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081506388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081506398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081506398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081506398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:09.143337 run osmo-msc_10.42.42.6(pid=11992): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11992)] 08:15:09.190319 run osmo-msc_10.42.42.6(pid=11992): stdout: | (launched: 2022-12-09_08:15:08.066872) 08:15:09.238705 run osmo-msc_10.42.42.6(pid=11992): stderr: | 20221209081508336 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081508336 DLGLOBAL DEBUG validating counter group 0x7f7ec7ab9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081508336 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081508336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081508336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081508336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081508338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081508338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081508339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081508339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:09.287620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11985): Terminating (SIGTERM) 08:15:09.326804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11988): Terminating (SIGTERM) 08:15:09.365915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11991): Terminating (SIGTERM) 08:15:09.405170 --- ParallelTerminationStrategy: PID 11985 died... 08:15:09.424159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11985): Terminated: ok {rc=0} 08:15:09.467341 --- ParallelTerminationStrategy: PID 11988 died... 08:15:09.485848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11988): Terminated: ok {rc=0} 08:15:09.529096 --- ParallelTerminationStrategy: PID 11991 died... 08:15:09.547573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11991): Terminated: ok {rc=0} 08:15:09.632102 bus /sierra_3: Setting Powered False 08:15:10.729413 bus /sierra_3: Setting Powered False 08:15:11.843736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 08:15:13.115855 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:13.121749 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:15:13.162230 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:15:13.194635 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:15:13.249235 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:15:13.294795 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:15:13.322335 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:15:13.866834 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 08:15:13.873900 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:13.886876 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 08:15:13.923943 tst handover.py: using LAC 20133 08:15:14.058655 tst handover.py: using RAC 243 08:15:14.188149 tst handover.py: using CellId 20133 08:15:14.314128 tst handover.py: using BVCI 20134 08:15:14.430175 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 08:15:14.466246 tst handover.py: using LAC 20134 08:15:14.588616 tst handover.py: using RAC 244 08:15:14.711534 tst handover.py: using CellId 20134 08:15:14.831093 tst handover.py: using BVCI 20135 08:15:14.943912 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:14.954935 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:14.965748 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:14.976543 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:14.987370 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:14.998297 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 08:15:15.118853 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 08:15:15.235157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:15.681654 run create_hlr_db(pid=12348): Launched 08:15:15.804925 bus /sierra_2: Setting Powered False 08:15:16.879810 run create_hlr_db(pid=12348): Terminated: ok {rc=0} 08:15:17.358718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12350): Launched 08:15:17.684732 run osmo-hlr_10.42.42.2(pid=12351): Launched 08:15:17.811004 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:18.343846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12353): Launched 08:15:18.669018 run osmo-stp_10.42.42.5(pid=12354): Launched 08:15:18.794815 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:19.357602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12356): Launched 08:15:19.683078 run osmo-msc_10.42.42.6(pid=12357): Launched 08:15:19.867109 run osmo-stp_10.42.42.5(pid=12354): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12354)] 08:15:20.004914 run osmo-stp_10.42.42.5(pid=12354): stdout: | (launched: 2022-12-09_08:15:18.609441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:20.143344 run osmo-stp_10.42.42.5(pid=12354): stderr: | 20221209081518799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081518799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081518799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081518800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081518800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081518800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081518800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:20.279917 run osmo-stp_10.42.42.5(pid=12354): stdout: | (launched: 2022-12-09_08:15:18.609441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:20.409942 run osmo-stp_10.42.42.5(pid=12354): stderr: | 20221209081518799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081518799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081518799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081518800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081518800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081518800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081518800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:20.565194 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12354): Process ended prematurely: osmo-stp_10.42.42.5(pid=12354) [trial-2356↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12354)] [trial-2356↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 08:15:20.574300 tst handover.py:18: Test FAILED (6.7 sec) 08:15:20.602363 run osmo-hlr_10.42.42.2(pid=12351): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12351)] 08:15:20.652268 run osmo-hlr_10.42.42.2(pid=12351): stdout: | (launched: 2022-12-09_08:15:17.625485) 08:15:20.703461 run osmo-hlr_10.42.42.2(pid=12351): stderr: | 20221209081517819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081517819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081517819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081517819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081517819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081517819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081517831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081517841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081517841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081517841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:20.775632 run osmo-msc_10.42.42.6(pid=12357): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12357)] 08:15:20.825362 run osmo-msc_10.42.42.6(pid=12357): stdout: | (launched: 2022-12-09_08:15:19.623292) 08:15:20.876781 run osmo-msc_10.42.42.6(pid=12357): stderr: | 20221209081519942 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081519942 DLGLOBAL DEBUG validating counter group 0x7f46815eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081519942 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081519942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081519942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081519942 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081519944 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081519945 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081519945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081519945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:20.928665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12350): Terminating (SIGTERM) 08:15:20.970687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12353): Terminating (SIGTERM) 08:15:21.012881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12356): Terminating (SIGTERM) 08:15:21.055131 --- ParallelTerminationStrategy: PID 12350 died... 08:15:21.074957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12350): Terminated: ok {rc=0} 08:15:21.121539 --- ParallelTerminationStrategy: PID 12353 died... 08:15:21.140822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12353): Terminated: ok {rc=0} 08:15:21.187144 --- ParallelTerminationStrategy: PID 12356 died... 08:15:21.206720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12356): Terminated: ok {rc=0} 08:15:21.294180 bus /sierra_3: Setting Powered False 08:15:22.391624 bus /sierra_3: Setting Powered False 08:15:23.512199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 08:15:24.759026 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:24.764864 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:15:24.817832 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:15:24.846685 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:15:24.898048 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:15:24.950966 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:15:24.980224 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:15:25.530043 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 08:15:25.536819 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:25.548583 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:15:25.583086 tst handover.py: using LAC 20135 08:15:25.708849 tst handover.py: using RAC 245 08:15:25.830531 tst handover.py: using CellId 20135 08:15:25.953468 tst handover.py: using BVCI 20136 08:15:26.069397 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:15:26.118482 tst handover.py: using LAC 20136 08:15:26.242484 tst handover.py: using RAC 246 08:15:26.365452 tst handover.py: using CellId 20136 08:15:26.489874 tst handover.py: using BVCI 20137 08:15:26.605948 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:26.617997 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:26.629685 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:26.641408 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:26.653081 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:26.665269 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:15:26.785796 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:15:26.905638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:27.366758 run create_hlr_db(pid=12537): Launched 08:15:27.530413 bus /sierra_2: Setting Powered False 08:15:28.594455 run create_hlr_db(pid=12537): Terminated: ok {rc=0} 08:15:29.014148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12540): Launched 08:15:29.323531 run osmo-hlr_10.42.42.2(pid=12541): Launched 08:15:29.442511 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:29.962243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12543): Launched 08:15:30.271256 run osmo-stp_10.42.42.5(pid=12544): Launched 08:15:30.389557 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:30.941448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12546): Launched 08:15:31.289713 run osmo-msc_10.42.42.6(pid=12547): Launched 08:15:31.669181 run osmo-stp_10.42.42.5(pid=12544): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12544)] 08:15:31.870111 run osmo-stp_10.42.42.5(pid=12544): stdout: | (launched: 2022-12-09_08:15:30.214457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:32.130886 run osmo-stp_10.42.42.5(pid=12544): stderr: | 20221209081530383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081530383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081530383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081530384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081530384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081530384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081530385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:32.274594 run osmo-stp_10.42.42.5(pid=12544): stdout: | (launched: 2022-12-09_08:15:30.214457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:32.405179 run osmo-stp_10.42.42.5(pid=12544): stderr: | 20221209081530383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081530383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081530383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081530384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081530384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081530384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081530385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:32.561357 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12544): Process ended prematurely: osmo-stp_10.42.42.5(pid=12544) [trial-2356↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12544)] [trial-2356↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 08:15:32.570362 tst handover.py:18: Test FAILED (7.0 sec) 08:15:32.597662 run osmo-hlr_10.42.42.2(pid=12541): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12541)] 08:15:32.647476 run osmo-hlr_10.42.42.2(pid=12541): stdout: | (launched: 2022-12-09_08:15:29.266704) 08:15:32.699575 run osmo-hlr_10.42.42.2(pid=12541): stderr: | 20221209081529441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081529441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081529441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081529441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081529441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081529442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081529454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081529462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081529463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081529463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:32.771856 run osmo-msc_10.42.42.6(pid=12547): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12547)] 08:15:32.821820 run osmo-msc_10.42.42.6(pid=12547): stdout: | (launched: 2022-12-09_08:15:31.221664) 08:15:32.873643 run osmo-msc_10.42.42.6(pid=12547): stderr: | 20221209081531732 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081531733 DLGLOBAL DEBUG validating counter group 0x7f2eb1551c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081531733 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081531733 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081531733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081531733 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081531735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081531735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081531735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081531735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:32.925909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12540): Terminating (SIGTERM) 08:15:32.967577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12543): Terminating (SIGTERM) 08:15:33.009878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12546): Terminating (SIGTERM) 08:15:33.052192 --- ParallelTerminationStrategy: PID 12540 died... 08:15:33.072114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12540): Terminated: ok {rc=0} 08:15:33.118337 --- ParallelTerminationStrategy: PID 12543 died... 08:15:33.138108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12543): Terminated: ok {rc=0} 08:15:33.183870 --- ParallelTerminationStrategy: PID 12546 died... 08:15:33.203508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12546): Terminated: ok {rc=0} 08:15:33.290991 bus /sierra_3: Setting Powered False 08:15:34.386418 bus /sierra_3: Setting Powered False 08:15:35.500203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 08:15:36.755149 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:36.760275 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:15:36.810645 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:15:36.837633 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:15:36.893908 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:15:36.943584 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:15:36.970568 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:15:37.518100 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 08:15:37.523694 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:37.534863 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:15:37.568899 tst handover.py: using LAC 20137 08:15:37.689266 tst handover.py: using RAC 247 08:15:37.810849 tst handover.py: using CellId 20137 08:15:37.934596 tst handover.py: using BVCI 20138 08:15:38.047004 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:15:38.093449 tst handover.py: using LAC 20138 08:15:38.221519 tst handover.py: using RAC 248 08:15:38.352659 tst handover.py: using CellId 20138 08:15:38.472735 tst handover.py: using BVCI 20139 08:15:38.583604 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:38.594727 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:38.605979 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:38.616753 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:38.627655 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:38.638295 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:15:38.760721 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:15:38.879183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:39.331824 run create_hlr_db(pid=12552): Launched 08:15:39.459572 bus /sierra_2: Setting Powered False 08:15:40.520124 run create_hlr_db(pid=12552): Terminated: ok {rc=0} 08:15:40.938636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Launched 08:15:41.268495 run osmo-hlr_10.42.42.2(pid=12555): Launched 08:15:41.397128 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:41.934014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Launched 08:15:42.262155 run osmo-stp_10.42.42.5(pid=12558): Launched 08:15:42.389741 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:42.955973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12560): Launched 08:15:43.286860 run osmo-msc_10.42.42.6(pid=12561): Launched 08:15:43.472194 run osmo-stp_10.42.42.5(pid=12558): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] 08:15:43.610931 run osmo-stp_10.42.42.5(pid=12558): stdout: | (launched: 2022-12-09_08:15:42.202206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:43.750459 run osmo-stp_10.42.42.5(pid=12558): stderr: | 20221209081542391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081542392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081542392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081542393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081542393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081542393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081542393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:43.887249 run osmo-stp_10.42.42.5(pid=12558): stdout: | (launched: 2022-12-09_08:15:42.202206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:44.018028 run osmo-stp_10.42.42.5(pid=12558): stderr: | 20221209081542391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081542392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081542392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081542393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081542393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081542393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081542393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:44.174286 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12558): Process ended prematurely: osmo-stp_10.42.42.5(pid=12558) [trial-2356↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] [trial-2356↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 08:15:44.183357 tst handover.py:18: Test FAILED (6.7 sec) 08:15:44.210664 run osmo-hlr_10.42.42.2(pid=12555): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12555)] 08:15:44.260693 run osmo-hlr_10.42.42.2(pid=12555): stdout: | (launched: 2022-12-09_08:15:41.208382) 08:15:44.312500 run osmo-hlr_10.42.42.2(pid=12555): stderr: | 20221209081541404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081541404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081541404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081541404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081541404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081541404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081541417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081541425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081541425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081541426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:44.384450 run osmo-msc_10.42.42.6(pid=12561): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12561)] 08:15:44.434524 run osmo-msc_10.42.42.6(pid=12561): stdout: | (launched: 2022-12-09_08:15:43.226625) 08:15:44.485928 run osmo-msc_10.42.42.6(pid=12561): stderr: | 20221209081543546 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081543546 DLGLOBAL DEBUG validating counter group 0x7f769bcb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081543547 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081543547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081543547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081543547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081543549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081543549 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081543549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081543549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:44.537739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Terminating (SIGTERM) 08:15:44.578860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Terminating (SIGTERM) 08:15:44.620361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12560): Terminating (SIGTERM) 08:15:44.662154 --- ParallelTerminationStrategy: PID 12554 died... 08:15:44.682324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Terminated: ok {rc=0} 08:15:44.728475 --- ParallelTerminationStrategy: PID 12557 died... 08:15:44.747893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Terminated: ok {rc=0} 08:15:44.793977 --- ParallelTerminationStrategy: PID 12560 died... 08:15:44.813570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12560): Terminated: ok {rc=0} 08:15:44.901830 bus /sierra_3: Setting Powered False 08:15:46.008026 bus /sierra_3: Setting Powered False 08:15:47.142770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 08:15:48.408287 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:48.414246 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:15:48.464939 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:15:48.493070 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:15:48.547379 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:15:48.598384 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:15:48.625889 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:15:49.179559 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 08:15:49.184910 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:49.196435 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:15:49.234674 tst handover.py: using LAC 20139 08:15:49.363615 tst handover.py: using RAC 249 08:15:49.492485 tst handover.py: using CellId 20139 08:15:49.621540 tst handover.py: using BVCI 20140 08:15:49.733972 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:15:49.781396 tst handover.py: using LAC 20140 08:15:49.906795 tst handover.py: using RAC 250 08:15:50.026503 tst handover.py: using CellId 20140 08:15:50.146462 tst handover.py: using BVCI 20141 08:15:50.258784 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:50.270252 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:50.281064 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:50.291744 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:50.302557 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:50.313313 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:15:50.434270 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:15:50.552791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:51.003113 run create_hlr_db(pid=12566): Launched 08:15:51.130993 bus /sierra_2: Setting Powered False 08:15:52.191427 run create_hlr_db(pid=12566): Terminated: ok {rc=0} 08:15:52.610745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12568): Launched 08:15:52.940825 run osmo-hlr_10.42.42.2(pid=12569): Launched 08:15:53.066776 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:53.604139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12571): Launched 08:15:53.931777 run osmo-stp_10.42.42.5(pid=12572): Launched 08:15:54.059182 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:54.628236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12574): Launched 08:15:54.958898 run osmo-msc_10.42.42.6(pid=12575): Launched 08:15:55.145445 run osmo-stp_10.42.42.5(pid=12572): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12572)] 08:15:55.285181 run osmo-stp_10.42.42.5(pid=12572): stdout: | (launched: 2022-12-09_08:15:53.871508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:55.424508 run osmo-stp_10.42.42.5(pid=12572): stderr: | 20221209081554063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081554063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081554063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081554063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081554064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081554064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081554064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:55.562806 run osmo-stp_10.42.42.5(pid=12572): stdout: | (launched: 2022-12-09_08:15:53.871508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:55.693417 run osmo-stp_10.42.42.5(pid=12572): stderr: | 20221209081554063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081554063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081554063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081554063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081554064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081554064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081554064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:55.849749 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12572): Process ended prematurely: osmo-stp_10.42.42.5(pid=12572) [trial-2356↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12572)] [trial-2356↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 08:15:55.858788 tst handover.py:18: Test FAILED (6.7 sec) 08:15:55.886219 run osmo-hlr_10.42.42.2(pid=12569): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12569)] 08:15:55.936248 run osmo-hlr_10.42.42.2(pid=12569): stdout: | (launched: 2022-12-09_08:15:52.880250) 08:15:55.988188 run osmo-hlr_10.42.42.2(pid=12569): stderr: | 20221209081553079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081553079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081553079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081553079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081553079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081553079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081553095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081553105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081553106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081553106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:56.060305 run osmo-msc_10.42.42.6(pid=12575): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12575)] 08:15:56.110353 run osmo-msc_10.42.42.6(pid=12575): stdout: | (launched: 2022-12-09_08:15:54.898691) 08:15:56.161781 run osmo-msc_10.42.42.6(pid=12575): stderr: | 20221209081555219 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081555220 DLGLOBAL DEBUG validating counter group 0x7f55410a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081555220 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081555220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081555220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081555220 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081555222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081555222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081555223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081555223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:56.213626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12568): Terminating (SIGTERM) 08:15:56.255261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12571): Terminating (SIGTERM) 08:15:56.297066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12574): Terminating (SIGTERM) 08:15:56.339086 --- ParallelTerminationStrategy: PID 12568 died... 08:15:56.359015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12568): Terminated: ok {rc=0} 08:15:56.405205 --- ParallelTerminationStrategy: PID 12571 died... 08:15:56.425042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12571): Terminated: ok {rc=0} 08:15:56.471014 --- ParallelTerminationStrategy: PID 12574 died... 08:15:56.490761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12574): Terminated: ok {rc=0} 08:15:56.578526 bus /sierra_3: Setting Powered False 08:15:57.676850 bus /sierra_3: Setting Powered False 08:15:58.794868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:16:00.061410 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:00.067152 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:16:00.114129 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:16:00.142638 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:16:00.195035 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:16:00.241093 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:16:00.267922 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:16:00.823139 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:16:00.828797 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:00.846315 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:16:00.890023 tst handover.py: using LAC 20141 08:16:01.030621 tst handover.py: using RAC 251 08:16:01.153693 tst handover.py: using CellId 20141 08:16:01.276148 tst handover.py: using BVCI 20142 08:16:01.399923 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:16:01.446907 tst handover.py: using LAC 20142 08:16:01.580818 tst handover.py: using RAC 252 08:16:01.707043 tst handover.py: using CellId 20142 08:16:01.833520 tst handover.py: using BVCI 20143 08:16:01.949215 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:01.961795 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:01.973434 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:01.985243 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:01.996863 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:02.008818 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:16:02.134560 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:16:02.260553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:02.745778 run create_hlr_db(pid=12581): Launched 08:16:02.872730 bus /sierra_2: Setting Powered False 08:16:03.938371 run create_hlr_db(pid=12581): Terminated: ok {rc=0} 08:16:04.351819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12583): Launched 08:16:04.683812 run osmo-hlr_10.42.42.2(pid=12584): Launched 08:16:04.810853 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:05.350059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12586): Launched 08:16:05.679578 run osmo-stp_10.42.42.5(pid=12587): Launched 08:16:05.805719 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:06.370689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12589): Launched 08:16:06.701856 run osmo-msc_10.42.42.6(pid=12590): Launched 08:16:06.886442 run osmo-stp_10.42.42.5(pid=12587): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12587)] 08:16:07.025614 run osmo-stp_10.42.42.5(pid=12587): stdout: | (launched: 2022-12-09_08:16:05.618798) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:07.165554 run osmo-stp_10.42.42.5(pid=12587): stderr: | 20221209081605809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081605810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081605810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081605810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081605811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081605811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081605811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:07.304202 run osmo-stp_10.42.42.5(pid=12587): stdout: | (launched: 2022-12-09_08:16:05.618798) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:07.435924 run osmo-stp_10.42.42.5(pid=12587): stderr: | 20221209081605809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081605810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081605810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081605810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081605811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081605811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081605811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:07.593304 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12587): Process ended prematurely: osmo-stp_10.42.42.5(pid=12587) [trial-2356↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12587)] [trial-2356↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 08:16:07.602449 tst handover.py:18: Test FAILED (6.8 sec) 08:16:07.629895 run osmo-hlr_10.42.42.2(pid=12584): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12584)] 08:16:07.679686 run osmo-hlr_10.42.42.2(pid=12584): stdout: | (launched: 2022-12-09_08:16:04.623331) 08:16:07.731906 run osmo-hlr_10.42.42.2(pid=12584): stderr: | 20221209081604819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081604819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081604819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081604819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081604820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081604820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081604873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081604882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081604882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081604883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:07.803942 run osmo-msc_10.42.42.6(pid=12590): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12590)] 08:16:07.854017 run osmo-msc_10.42.42.6(pid=12590): stdout: | (launched: 2022-12-09_08:16:06.640934) 08:16:07.905899 run osmo-msc_10.42.42.6(pid=12590): stderr: | 20221209081606962 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081606962 DLGLOBAL DEBUG validating counter group 0x7f70e94eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081606962 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081606962 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081606962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081606962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081606964 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081606965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081606965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081606965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:07.957733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12583): Terminating (SIGTERM) 08:16:07.999339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12586): Terminating (SIGTERM) 08:16:08.041358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12589): Terminating (SIGTERM) 08:16:08.083286 --- ParallelTerminationStrategy: PID 12583 died... 08:16:08.103122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12583): Terminated: ok {rc=0} 08:16:08.149614 --- ParallelTerminationStrategy: PID 12586 died... 08:16:08.169087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12586): Terminated: ok {rc=0} 08:16:08.215105 --- ParallelTerminationStrategy: PID 12589 died... 08:16:08.234743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12589): Terminated: ok {rc=0} 08:16:08.322110 bus /sierra_3: Setting Powered False 08:16:09.419958 bus /sierra_3: Setting Powered False 08:16:10.534223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:16:11.789921 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:11.795495 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:16:11.846818 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:16:11.874349 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:16:11.927774 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:16:11.978091 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:16:12.005200 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:16:12.558609 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:16:12.563683 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:16:12.574899 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:16:12.608501 tst handover.py: using LAC 20143 08:16:12.731000 tst handover.py: using RAC 253 08:16:12.852812 tst handover.py: using CellId 20143 08:16:12.972465 tst handover.py: using BVCI 20144 08:16:13.084089 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:16:13.134108 tst handover.py: using LAC 20144 08:16:13.263862 tst handover.py: using RAC 254 08:16:13.391198 tst handover.py: using CellId 20144 08:16:13.520171 tst handover.py: using BVCI 20145 08:16:13.641451 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:16:13.653078 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:16:13.664549 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:16:13.676059 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:16:13.687488 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:16:13.698927 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:16:13.815710 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:16:13.931823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:14.384071 run create_hlr_db(pid=12595): Launched 08:16:14.510193 bus /sierra_2: Setting Powered False 08:16:15.571312 run create_hlr_db(pid=12595): Terminated: ok {rc=0} 08:16:16.002131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12597): Launched 08:16:16.336203 run osmo-hlr_10.42.42.2(pid=12598): Launched 08:16:16.652419 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:17.266208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12600): Launched 08:16:17.609642 run osmo-stp_10.42.42.5(pid=12601): Launched 08:16:17.729538 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:18.259477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12603): Launched 08:16:18.567588 run osmo-msc_10.42.42.6(pid=12604): Launched 08:16:18.740120 run osmo-stp_10.42.42.5(pid=12601): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12601)] 08:16:18.869532 run osmo-stp_10.42.42.5(pid=12601): stdout: | (launched: 2022-12-09_08:16:17.548810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:18.999035 run osmo-stp_10.42.42.5(pid=12601): stderr: | 20221209081617721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081617721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081617721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081617721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081617722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081617722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081617722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:19.127128 run osmo-stp_10.42.42.5(pid=12601): stdout: | (launched: 2022-12-09_08:16:17.548810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:19.248684 run osmo-stp_10.42.42.5(pid=12601): stderr: | 20221209081617721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081617721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081617721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081617721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081617722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081617722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081617722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:19.394714 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12601): Process ended prematurely: osmo-stp_10.42.42.5(pid=12601) [trial-2356↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12601)] [trial-2356↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 08:16:19.403567 tst handover.py:18: Test FAILED (6.8 sec) 08:16:19.430160 run osmo-hlr_10.42.42.2(pid=12598): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12598)] 08:16:19.477814 run osmo-hlr_10.42.42.2(pid=12598): stdout: | (launched: 2022-12-09_08:16:16.278630) 08:16:19.527079 run osmo-hlr_10.42.42.2(pid=12598): stderr: | 20221209081616617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081616617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081616617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081616617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081616617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081616617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081616634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081616652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081616656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081616656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:19.595535 run osmo-msc_10.42.42.6(pid=12604): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12604)] 08:16:19.643206 run osmo-msc_10.42.42.6(pid=12604): stdout: | (launched: 2022-12-09_08:16:18.510707) 08:16:19.692308 run osmo-msc_10.42.42.6(pid=12604): stderr: | 20221209081618782 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081618782 DLGLOBAL DEBUG validating counter group 0x7f897375ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081618782 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081618782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081618782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081618783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081618784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081618785 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081618785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081618785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:19.741876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12597): Terminating (SIGTERM) 08:16:19.781136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12600): Terminating (SIGTERM) 08:16:19.820489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12603): Terminating (SIGTERM) 08:16:19.860108 --- ParallelTerminationStrategy: PID 12597 died... 08:16:19.879320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12597): Terminated: ok {rc=0} 08:16:19.922876 --- ParallelTerminationStrategy: PID 12600 died... 08:16:19.941842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12600): Terminated: ok {rc=0} 08:16:19.985366 --- ParallelTerminationStrategy: PID 12603 died... 08:16:20.004007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12603): Terminated: ok {rc=0} 08:16:20.090643 bus /sierra_3: Setting Powered False 08:16:21.188612 bus /sierra_3: Setting Powered False 08:16:22.303334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 08:16:23.565761 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:23.570812 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:16:23.607738 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:16:23.634471 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:16:23.687542 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:16:23.725371 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:16:23.751914 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:16:24.302562 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 08:16:24.308001 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:24.319117 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:24.352294 tst handover.py: using LAC 20145 08:16:24.474081 tst handover.py: using RAC 255 08:16:24.594841 tst handover.py: using CellId 20145 08:16:24.717062 tst handover.py: using BVCI 20146 08:16:24.829874 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:24.869467 tst handover.py: using LAC 20146 08:16:24.990539 tst handover.py: using RAC 1 08:16:25.111005 tst handover.py: using CellId 20146 08:16:25.234765 tst handover.py: using BVCI 20147 08:16:25.348304 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:25.359406 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:25.370288 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:25.381361 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:25.392102 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:25.403026 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:25.524649 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:25.641940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:26.094518 run create_hlr_db(pid=12609): Launched 08:16:26.228421 bus /sierra_2: Setting Powered False 08:16:27.293101 run create_hlr_db(pid=12609): Terminated: ok {rc=0} 08:16:27.721574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12611): Launched 08:16:28.051006 run osmo-hlr_10.42.42.2(pid=12612): Launched 08:16:28.178877 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:28.713644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12614): Launched 08:16:29.042858 run osmo-stp_10.42.42.5(pid=12615): Launched 08:16:29.169151 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:29.735525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12617): Launched 08:16:30.067343 run osmo-msc_10.42.42.6(pid=12618): Launched 08:16:30.254621 run osmo-stp_10.42.42.5(pid=12615): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12615)] 08:16:30.393239 run osmo-stp_10.42.42.5(pid=12615): stdout: | (launched: 2022-12-09_08:16:28.981631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:30.533199 run osmo-stp_10.42.42.5(pid=12615): stderr: | 20221209081629172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081629172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081629173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081629173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081629174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081629174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081629174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:30.670833 run osmo-stp_10.42.42.5(pid=12615): stdout: | (launched: 2022-12-09_08:16:28.981631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:30.802222 run osmo-stp_10.42.42.5(pid=12615): stderr: | 20221209081629172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081629172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081629173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081629173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081629174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081629174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081629174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:30.972742 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12615): Process ended prematurely: osmo-stp_10.42.42.5(pid=12615) [trial-2356↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12615)] [trial-2356↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 08:16:30.982759 tst handover.py:18: Test FAILED (6.7 sec) 08:16:31.011497 run osmo-hlr_10.42.42.2(pid=12612): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12612)] 08:16:31.062845 run osmo-hlr_10.42.42.2(pid=12612): stdout: | (launched: 2022-12-09_08:16:27.990414) 08:16:31.116677 run osmo-hlr_10.42.42.2(pid=12612): stderr: | 20221209081628187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081628187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081628187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081628187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081628188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081628188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081628199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081628209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081628209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081628209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:31.192337 run osmo-msc_10.42.42.6(pid=12618): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12618)] 08:16:31.244247 run osmo-msc_10.42.42.6(pid=12618): stdout: | (launched: 2022-12-09_08:16:30.006360) 08:16:31.298069 run osmo-msc_10.42.42.6(pid=12618): stderr: | 20221209081630328 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081630328 DLGLOBAL DEBUG validating counter group 0x7f8479b83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081630328 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081630328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081630328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081630329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081630330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081630331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081630331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081630331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:31.352386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12611): Terminating (SIGTERM) 08:16:31.394642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12614): Terminating (SIGTERM) 08:16:31.437951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12617): Terminating (SIGTERM) 08:16:31.482186 --- ParallelTerminationStrategy: PID 12611 died... 08:16:31.503620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12611): Terminated: ok {rc=0} 08:16:31.552464 --- ParallelTerminationStrategy: PID 12614 died... 08:16:31.574056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12614): Terminated: ok {rc=0} 08:16:31.622373 --- ParallelTerminationStrategy: PID 12617 died... 08:16:31.642838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12617): Terminated: ok {rc=0} 08:16:31.736352 bus /sierra_3: Setting Powered False 08:16:32.834933 bus /sierra_3: Setting Powered False 08:16:33.948541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 08:16:35.188389 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:35.193466 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:16:35.242525 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:16:35.269329 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:16:35.320787 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:16:35.370183 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:16:35.397129 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:16:35.950983 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 08:16:35.956284 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:35.967367 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:36.000591 tst handover.py: using LAC 20147 08:16:36.121062 tst handover.py: using RAC 2 08:16:36.241958 tst handover.py: using CellId 20147 08:16:36.364151 tst handover.py: using BVCI 20148 08:16:36.477624 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:36.526837 tst handover.py: using LAC 20148 08:16:36.646937 tst handover.py: using RAC 3 08:16:36.768811 tst handover.py: using CellId 20148 08:16:36.889365 tst handover.py: using BVCI 20149 08:16:37.000872 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:37.012003 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:37.022982 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:37.034071 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:37.044901 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:37.055708 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:37.176706 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:37.294271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:37.746533 run create_hlr_db(pid=12623): Launched 08:16:37.874592 bus /sierra_2: Setting Powered False 08:16:38.938506 run create_hlr_db(pid=12623): Terminated: ok {rc=0} 08:16:39.350958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Launched 08:16:39.659513 run osmo-hlr_10.42.42.2(pid=12626): Launched 08:16:39.776691 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:40.277474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Launched 08:16:40.583107 run osmo-stp_10.42.42.5(pid=12629): Launched 08:16:40.699637 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:41.227078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12631): Launched 08:16:41.535141 run osmo-msc_10.42.42.6(pid=12632): Launched 08:16:41.707953 run osmo-stp_10.42.42.5(pid=12629): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] 08:16:41.837476 run osmo-stp_10.42.42.5(pid=12629): stdout: | (launched: 2022-12-09_08:16:40.526327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:41.967285 run osmo-stp_10.42.42.5(pid=12629): stderr: | 20221209081640696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081640696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081640696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081640697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081640697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081640697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081640697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:42.095138 run osmo-stp_10.42.42.5(pid=12629): stdout: | (launched: 2022-12-09_08:16:40.526327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:42.216876 run osmo-stp_10.42.42.5(pid=12629): stderr: | 20221209081640696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081640696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081640696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081640697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081640697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081640697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081640697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:42.362884 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12629): Process ended prematurely: osmo-stp_10.42.42.5(pid=12629) [trial-2356↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] [trial-2356↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 08:16:42.371215 tst handover.py:18: Test FAILED (6.4 sec) 08:16:42.397321 run osmo-hlr_10.42.42.2(pid=12626): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12626)] 08:16:42.444860 run osmo-hlr_10.42.42.2(pid=12626): stdout: | (launched: 2022-12-09_08:16:39.602707) 08:16:42.494256 run osmo-hlr_10.42.42.2(pid=12626): stderr: | 20221209081639776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081639776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081639776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081639776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081639776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081639776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081639788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081639797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081639797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081639797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:42.562775 run osmo-msc_10.42.42.6(pid=12632): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12632)] 08:16:42.610035 run osmo-msc_10.42.42.6(pid=12632): stdout: | (launched: 2022-12-09_08:16:41.478000) 08:16:42.658959 run osmo-msc_10.42.42.6(pid=12632): stderr: | 20221209081641752 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081641752 DLGLOBAL DEBUG validating counter group 0x7f5d3f705c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081641752 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081641753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081641753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081641753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081641755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081641755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081641755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081641755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:42.708232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Terminating (SIGTERM) 08:16:42.747249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Terminating (SIGTERM) 08:16:42.786356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12631): Terminating (SIGTERM) 08:16:42.826408 --- ParallelTerminationStrategy: PID 12625 died... 08:16:42.845674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Terminated: ok {rc=0} 08:16:42.889445 --- ParallelTerminationStrategy: PID 12628 died... 08:16:42.908053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Terminated: ok {rc=0} 08:16:42.951668 --- ParallelTerminationStrategy: PID 12631 died... 08:16:42.970525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12631): Terminated: ok {rc=0} 08:16:43.056715 bus /sierra_3: Setting Powered False 08:16:44.155793 bus /sierra_3: Setting Powered False 08:16:45.269999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 08:16:46.573663 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:46.581994 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:16:46.640589 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:16:46.674768 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:16:46.737487 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:16:46.797181 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:16:46.829786 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:16:47.364144 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 08:16:47.369298 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:47.380083 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:16:47.413181 tst handover.py: using LAC 20149 08:16:47.537824 tst handover.py: using RAC 4 08:16:47.669900 tst handover.py: using CellId 20149 08:16:47.801464 tst handover.py: using BVCI 20150 08:16:47.924008 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:16:47.973767 tst handover.py: using LAC 20150 08:16:48.105760 tst handover.py: using RAC 5 08:16:48.237075 tst handover.py: using CellId 20150 08:16:48.367765 tst handover.py: using BVCI 20151 08:16:48.487743 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:48.499289 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:48.510578 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:48.521890 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:48.533298 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:48.544426 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:16:48.664330 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:16:48.783031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:49.234856 run create_hlr_db(pid=12637): Launched 08:16:49.362480 bus /sierra_2: Setting Powered False 08:16:50.423565 run create_hlr_db(pid=12637): Terminated: ok {rc=0} 08:16:50.843942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12639): Launched 08:16:51.175819 run osmo-hlr_10.42.42.2(pid=12640): Launched 08:16:51.304287 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:51.844536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12642): Launched 08:16:52.175973 run osmo-stp_10.42.42.5(pid=12643): Launched 08:16:52.302442 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:52.871196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12645): Launched 08:16:53.204137 run osmo-msc_10.42.42.6(pid=12646): Launched 08:16:53.388633 run osmo-stp_10.42.42.5(pid=12643): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12643)] 08:16:53.526998 run osmo-stp_10.42.42.5(pid=12643): stdout: | (launched: 2022-12-09_08:16:52.115265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:53.666166 run osmo-stp_10.42.42.5(pid=12643): stderr: | 20221209081652306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081652306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081652306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081652307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081652307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081652307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081652307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:53.804303 run osmo-stp_10.42.42.5(pid=12643): stdout: | (launched: 2022-12-09_08:16:52.115265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:53.935674 run osmo-stp_10.42.42.5(pid=12643): stderr: | 20221209081652306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081652306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081652306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081652307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081652307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081652307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081652307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:54.093322 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12643): Process ended prematurely: osmo-stp_10.42.42.5(pid=12643) [trial-2356↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12643)] [trial-2356↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 08:16:54.102579 tst handover.py:18: Test FAILED (6.7 sec) 08:16:54.130026 run osmo-hlr_10.42.42.2(pid=12640): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12640)] 08:16:54.180453 run osmo-hlr_10.42.42.2(pid=12640): stdout: | (launched: 2022-12-09_08:16:51.115434) 08:16:54.232647 run osmo-hlr_10.42.42.2(pid=12640): stderr: | 20221209081651313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081651313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081651313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081651313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081651313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081651313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081651326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081651336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081651337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081651337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:54.304594 run osmo-msc_10.42.42.6(pid=12646): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12646)] 08:16:54.354721 run osmo-msc_10.42.42.6(pid=12646): stdout: | (launched: 2022-12-09_08:16:53.143127) 08:16:54.405898 run osmo-msc_10.42.42.6(pid=12646): stderr: | 20221209081653467 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081653468 DLGLOBAL DEBUG validating counter group 0x7fdd95fc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081653468 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081653468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081653468 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081653468 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081653470 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081653470 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081653470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081653471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:54.458248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12639): Terminating (SIGTERM) 08:16:54.499623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12642): Terminating (SIGTERM) 08:16:54.541611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12645): Terminating (SIGTERM) 08:16:54.583860 --- ParallelTerminationStrategy: PID 12639 died... 08:16:54.604180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12639): Terminated: ok {rc=0} 08:16:54.650419 --- ParallelTerminationStrategy: PID 12642 died... 08:16:54.670047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12642): Terminated: ok {rc=0} 08:16:54.716475 --- ParallelTerminationStrategy: PID 12645 died... 08:16:54.735953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12645): Terminated: ok {rc=0} 08:16:54.824635 bus /sierra_3: Setting Powered False 08:16:55.922338 bus /sierra_3: Setting Powered False 08:16:57.038974 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:16:58.304561 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:58.310884 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:16:58.372072 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:16:58.401995 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:16:58.453510 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:16:58.515439 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:16:58.543192 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:16:59.100105 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:16:59.105820 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:16:59.117800 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:16:59.166793 tst handover.py: using LAC 20151 08:16:59.297168 tst handover.py: using RAC 6 08:16:59.424902 tst handover.py: using CellId 20151 08:16:59.545019 tst handover.py: using BVCI 20152 08:16:59.656434 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:16:59.701004 tst handover.py: using LAC 20152 08:16:59.821008 tst handover.py: using RAC 7 08:16:59.939707 tst handover.py: using CellId 20152 08:17:00.061664 tst handover.py: using BVCI 20153 08:17:00.173965 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:00.185118 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:00.195953 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:00.206985 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:00.217997 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:00.228826 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:17:00.351432 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:17:00.469186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:00.929733 run create_hlr_db(pid=12651): Launched 08:17:01.097701 bus /sierra_2: Setting Powered False 08:17:02.158231 run create_hlr_db(pid=12651): Terminated: ok {rc=0} 08:17:02.587252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12656): Launched 08:17:02.894883 run osmo-hlr_10.42.42.2(pid=12657): Launched 08:17:03.013769 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:03.529632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12659): Launched 08:17:03.838725 run osmo-stp_10.42.42.5(pid=12660): Launched 08:17:03.956480 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:04.486455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12662): Launched 08:17:04.796620 run osmo-msc_10.42.42.6(pid=12663): Launched 08:17:04.968325 run osmo-stp_10.42.42.5(pid=12660): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12660)] 08:17:05.097455 run osmo-stp_10.42.42.5(pid=12660): stdout: | (launched: 2022-12-09_08:17:03.781766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:05.227082 run osmo-stp_10.42.42.5(pid=12660): stderr: | 20221209081703950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081703950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081703951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081703951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081703952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081703952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081703952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:05.355314 run osmo-stp_10.42.42.5(pid=12660): stdout: | (launched: 2022-12-09_08:17:03.781766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:05.477387 run osmo-stp_10.42.42.5(pid=12660): stderr: | 20221209081703950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081703950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081703951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081703951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081703952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081703952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081703952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:05.623303 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12660): Process ended prematurely: osmo-stp_10.42.42.5(pid=12660) [trial-2356↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12660)] [trial-2356↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 08:17:05.631787 tst handover.py:18: Test FAILED (6.5 sec) 08:17:05.658007 run osmo-hlr_10.42.42.2(pid=12657): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12657)] 08:17:05.705584 run osmo-hlr_10.42.42.2(pid=12657): stdout: | (launched: 2022-12-09_08:17:02.837995) 08:17:05.754896 run osmo-hlr_10.42.42.2(pid=12657): stderr: | 20221209081703015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081703015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081703015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081703015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081703015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081703015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081703027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081703035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081703035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081703036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:05.823922 run osmo-msc_10.42.42.6(pid=12663): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12663)] 08:17:05.871274 run osmo-msc_10.42.42.6(pid=12663): stdout: | (launched: 2022-12-09_08:17:04.739655) 08:17:05.920776 run osmo-msc_10.42.42.6(pid=12663): stderr: | 20221209081705012 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081705012 DLGLOBAL DEBUG validating counter group 0x7f0550003c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081705012 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081705012 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081705012 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081705013 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081705014 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081705015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081705015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081705015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:05.970192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12656): Terminating (SIGTERM) 08:17:06.009524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12659): Terminating (SIGTERM) 08:17:06.049202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12662): Terminating (SIGTERM) 08:17:06.089127 --- ParallelTerminationStrategy: PID 12656 died... 08:17:06.108230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12656): Terminated: ok {rc=0} 08:17:06.152451 --- ParallelTerminationStrategy: PID 12659 died... 08:17:06.171179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12659): Terminated: ok {rc=0} 08:17:06.214599 --- ParallelTerminationStrategy: PID 12662 died... 08:17:06.233085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12662): Terminated: ok {rc=0} 08:17:06.318904 bus /sierra_3: Setting Powered False 08:17:07.419861 bus /sierra_3: Setting Powered False 08:17:08.534617 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:17:09.810389 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:09.816643 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:17:09.880715 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:17:09.908007 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:17:09.961968 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:17:10.032076 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:17:10.061381 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:17:10.608108 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:17:10.613873 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:10.625615 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:17:10.678693 tst handover.py: using LAC 20153 08:17:10.809316 tst handover.py: using RAC 8 08:17:10.940082 tst handover.py: using CellId 20153 08:17:11.068785 tst handover.py: using BVCI 20154 08:17:11.188742 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:17:11.243154 tst handover.py: using LAC 20154 08:17:11.371411 tst handover.py: using RAC 9 08:17:11.498227 tst handover.py: using CellId 20154 08:17:11.626754 tst handover.py: using BVCI 20155 08:17:11.746391 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:11.758184 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:11.769869 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:11.781598 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:11.793205 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:11.804632 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:17:11.923012 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:17:12.044535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:12.526276 run create_hlr_db(pid=12668): Launched 08:17:12.653391 bus /sierra_2: Setting Powered False 08:17:13.717902 run create_hlr_db(pid=12668): Terminated: ok {rc=0} 08:17:14.130426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12670): Launched 08:17:14.439699 run osmo-hlr_10.42.42.2(pid=12671): Launched 08:17:14.558021 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:15.073428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12673): Launched 08:17:15.379010 run osmo-stp_10.42.42.5(pid=12674): Launched 08:17:15.496197 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:16.034105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12676): Launched 08:17:16.386708 run osmo-msc_10.42.42.6(pid=12677): Launched 08:17:16.810331 run osmo-stp_10.42.42.5(pid=12674): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12674)] 08:17:17.086881 run osmo-stp_10.42.42.5(pid=12674): stdout: | (launched: 2022-12-09_08:17:15.322375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:17.287926 run osmo-stp_10.42.42.5(pid=12674): stderr: | 20221209081715492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081715492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081715492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081715493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081715493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081715493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081715493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:17.424629 run osmo-stp_10.42.42.5(pid=12674): stdout: | (launched: 2022-12-09_08:17:15.322375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:17.555855 run osmo-stp_10.42.42.5(pid=12674): stderr: | 20221209081715492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081715492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081715492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081715493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081715493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081715493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081715493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:17.712694 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12674): Process ended prematurely: osmo-stp_10.42.42.5(pid=12674) [trial-2356↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12674)] [trial-2356↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 08:17:17.722027 tst handover.py:18: Test FAILED (7.1 sec) 08:17:17.749544 run osmo-hlr_10.42.42.2(pid=12671): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12671)] 08:17:17.799664 run osmo-hlr_10.42.42.2(pid=12671): stdout: | (launched: 2022-12-09_08:17:14.382146) 08:17:17.852752 run osmo-hlr_10.42.42.2(pid=12671): stderr: | 20221209081714559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081714559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081714559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081714559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081714559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081714559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081714572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081714582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081714582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081714582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:17.925421 run osmo-msc_10.42.42.6(pid=12677): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12677)] 08:17:17.975281 run osmo-msc_10.42.42.6(pid=12677): stdout: | (launched: 2022-12-09_08:17:16.323125) 08:17:18.026572 run osmo-msc_10.42.42.6(pid=12677): stderr: | 20221209081716825 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081716826 DLGLOBAL DEBUG validating counter group 0x7efeedd48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081716826 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081716826 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081716826 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081716827 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081716832 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081716832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081716832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081716832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:18.079060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12670): Terminating (SIGTERM) 08:17:18.120941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12673): Terminating (SIGTERM) 08:17:18.162427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12676): Terminating (SIGTERM) 08:17:18.204389 --- ParallelTerminationStrategy: PID 12670 died... 08:17:18.224115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12670): Terminated: ok {rc=0} 08:17:18.270143 --- ParallelTerminationStrategy: PID 12673 died... 08:17:18.289540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12673): Terminated: ok {rc=0} 08:17:18.335532 --- ParallelTerminationStrategy: PID 12676 died... 08:17:18.355118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12676): Terminated: ok {rc=0} 08:17:18.442866 bus /sierra_3: Setting Powered False 08:17:19.540129 bus /sierra_3: Setting Powered False 08:17:20.656487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 08:17:21.936849 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:21.942657 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:17:21.995063 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:17:22.022903 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:17:22.077984 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:17:22.131700 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:17:22.159802 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:17:22.710726 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 08:17:22.716463 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:22.728047 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 08:17:22.777040 tst handover.py: using LAC 20155 08:17:22.904848 tst handover.py: using RAC 10 08:17:23.026690 tst handover.py: using CellId 20155 08:17:23.148749 tst handover.py: using BVCI 20156 08:17:23.260105 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 08:17:23.295619 tst handover.py: using LAC 20156 08:17:23.416677 tst handover.py: using RAC 11 08:17:23.547342 tst handover.py: using CellId 20156 08:17:23.681583 tst handover.py: using BVCI 20157 08:17:23.803181 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:23.814828 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:23.826266 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:23.837712 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:23.849273 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:23.860511 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 08:17:23.980526 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 08:17:24.096479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:24.546718 run create_hlr_db(pid=12682): Launched 08:17:24.675130 bus /sierra_2: Setting Powered False 08:17:25.736213 run create_hlr_db(pid=12682): Terminated: ok {rc=0} 08:17:26.158716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Launched 08:17:26.489076 run osmo-hlr_10.42.42.2(pid=12685): Launched 08:17:26.618344 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:27.161691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Launched 08:17:27.492490 run osmo-stp_10.42.42.5(pid=12688): Launched 08:17:27.621963 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:28.195290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12690): Launched 08:17:28.526674 run osmo-msc_10.42.42.6(pid=12691): Launched 08:17:28.713283 run osmo-stp_10.42.42.5(pid=12688): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] 08:17:28.852692 run osmo-stp_10.42.42.5(pid=12688): stdout: | (launched: 2022-12-09_08:17:27.431888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:28.992887 run osmo-stp_10.42.42.5(pid=12688): stderr: | 20221209081727628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081727628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081727629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081727629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081727630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081727630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081727630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:29.131610 run osmo-stp_10.42.42.5(pid=12688): stdout: | (launched: 2022-12-09_08:17:27.431888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:29.263098 run osmo-stp_10.42.42.5(pid=12688): stderr: | 20221209081727628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081727628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081727629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081727629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081727630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081727630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081727630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:29.420008 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12688): Process ended prematurely: osmo-stp_10.42.42.5(pid=12688) [trial-2356↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] [trial-2356↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 08:17:29.429549 tst handover.py:18: Test FAILED (6.7 sec) 08:17:29.457105 run osmo-hlr_10.42.42.2(pid=12685): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12685)] 08:17:29.508128 run osmo-hlr_10.42.42.2(pid=12685): stdout: | (launched: 2022-12-09_08:17:26.428821) 08:17:29.560113 run osmo-hlr_10.42.42.2(pid=12685): stderr: | 20221209081726628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081726628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081726628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081726628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081726628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081726628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081726639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081726648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081726648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081726648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:29.632549 run osmo-msc_10.42.42.6(pid=12691): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12691)] 08:17:29.682717 run osmo-msc_10.42.42.6(pid=12691): stdout: | (launched: 2022-12-09_08:17:28.466139) 08:17:29.734172 run osmo-msc_10.42.42.6(pid=12691): stderr: | 20221209081728786 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081728786 DLGLOBAL DEBUG validating counter group 0x7f1ef7c38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081728786 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081728786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081728786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081728786 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081728788 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081728789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081728789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081728789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:29.786104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Terminating (SIGTERM) 08:17:29.827706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Terminating (SIGTERM) 08:17:29.869554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12690): Terminating (SIGTERM) 08:17:29.911857 --- ParallelTerminationStrategy: PID 12684 died... 08:17:29.932515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Terminated: ok {rc=0} 08:17:29.979481 --- ParallelTerminationStrategy: PID 12687 died... 08:17:29.999410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Terminated: ok {rc=0} 08:17:30.047083 --- ParallelTerminationStrategy: PID 12690 died... 08:17:30.067249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12690): Terminated: ok {rc=0} 08:17:30.156233 bus /sierra_3: Setting Powered False 08:17:31.252605 bus /sierra_3: Setting Powered False 08:17:32.370171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 08:17:33.625786 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:33.631055 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:17:33.694029 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:17:33.721354 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:17:33.772914 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:17:33.839625 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:17:33.867761 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:17:34.419001 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 08:17:34.424646 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:34.436209 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:17:34.484075 tst handover.py: using LAC 20157 08:17:34.614198 tst handover.py: using RAC 12 08:17:34.742916 tst handover.py: using CellId 20157 08:17:34.870155 tst handover.py: using BVCI 20158 08:17:34.989419 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:17:35.038424 tst handover.py: using LAC 20158 08:17:35.167432 tst handover.py: using RAC 13 08:17:35.294963 tst handover.py: using CellId 20158 08:17:35.415785 tst handover.py: using BVCI 20159 08:17:35.526900 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:35.537929 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:35.549307 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:35.560041 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:35.571102 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:35.581894 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:17:35.702921 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:17:35.818905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:36.305268 run create_hlr_db(pid=12700): Launched 08:17:36.431065 bus /sierra_2: Setting Powered False 08:17:37.495968 run create_hlr_db(pid=12700): Terminated: ok {rc=0} 08:17:37.925953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12702): Launched 08:17:38.255921 run osmo-hlr_10.42.42.2(pid=12703): Launched 08:17:38.383479 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:38.924746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12705): Launched 08:17:39.256294 run osmo-stp_10.42.42.5(pid=12706): Launched 08:17:39.384028 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:39.955267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12708): Launched 08:17:40.286790 run osmo-msc_10.42.42.6(pid=12709): Launched 08:17:40.473479 run osmo-stp_10.42.42.5(pid=12706): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12706)] 08:17:40.612466 run osmo-stp_10.42.42.5(pid=12706): stdout: | (launched: 2022-12-09_08:17:39.195855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:40.752687 run osmo-stp_10.42.42.5(pid=12706): stderr: | 20221209081739388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081739388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081739389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081739389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081739390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081739390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081739390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:40.890935 run osmo-stp_10.42.42.5(pid=12706): stdout: | (launched: 2022-12-09_08:17:39.195855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:41.022381 run osmo-stp_10.42.42.5(pid=12706): stderr: | 20221209081739388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081739388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081739389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081739389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081739390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081739390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081739390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:41.179941 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12706): Process ended prematurely: osmo-stp_10.42.42.5(pid=12706) [trial-2356↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12706)] [trial-2356↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 08:17:41.189204 tst handover.py:18: Test FAILED (6.8 sec) 08:17:41.216758 run osmo-hlr_10.42.42.2(pid=12703): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12703)] 08:17:41.267252 run osmo-hlr_10.42.42.2(pid=12703): stdout: | (launched: 2022-12-09_08:17:38.195496) 08:17:41.319163 run osmo-hlr_10.42.42.2(pid=12703): stderr: | 20221209081738393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081738393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081738393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081738393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081738393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081738393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081738404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081738414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081738414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081738414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:41.391206 run osmo-msc_10.42.42.6(pid=12709): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12709)] 08:17:41.441382 run osmo-msc_10.42.42.6(pid=12709): stdout: | (launched: 2022-12-09_08:17:40.226161) 08:17:41.492855 run osmo-msc_10.42.42.6(pid=12709): stderr: | 20221209081740548 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081740548 DLGLOBAL DEBUG validating counter group 0x7f6f23f92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081740548 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081740549 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081740549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081740549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081740551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081740551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081740551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081740551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:41.544780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12702): Terminating (SIGTERM) 08:17:41.586533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12705): Terminating (SIGTERM) 08:17:41.628029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12708): Terminating (SIGTERM) 08:17:41.670268 --- ParallelTerminationStrategy: PID 12702 died... 08:17:41.690691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12702): Terminated: ok {rc=0} 08:17:41.736781 --- ParallelTerminationStrategy: PID 12705 died... 08:17:41.756871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12705): Terminated: ok {rc=0} 08:17:41.803448 --- ParallelTerminationStrategy: PID 12708 died... 08:17:41.823488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12708): Terminated: ok {rc=0} 08:17:41.911385 bus /sierra_3: Setting Powered False 08:17:43.010847 bus /sierra_3: Setting Powered False 08:17:44.127214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 08:17:45.400429 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:45.405803 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:17:45.467816 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:17:45.494631 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:17:45.547580 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:17:45.610172 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:17:45.636845 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:17:46.190993 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 08:17:46.196877 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:46.209045 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:46.256613 tst handover.py: using LAC 20159 08:17:46.389028 tst handover.py: using RAC 14 08:17:46.522881 tst handover.py: using CellId 20159 08:17:46.648127 tst handover.py: using BVCI 20160 08:17:46.772391 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:46.829270 tst handover.py: using LAC 20160 08:17:47.001377 tst handover.py: using RAC 15 08:17:47.141381 tst handover.py: using CellId 20160 08:17:47.263669 tst handover.py: using BVCI 20161 08:17:47.375480 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:47.386489 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:47.397275 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:47.408034 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:47.418769 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:47.429606 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:47.550368 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:47.670033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:48.135026 run create_hlr_db(pid=12714): Launched 08:17:48.260150 bus /sierra_2: Setting Powered False 08:17:49.320110 run create_hlr_db(pid=12714): Terminated: ok {rc=0} 08:17:49.740017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12716): Launched 08:17:50.070201 run osmo-hlr_10.42.42.2(pid=12717): Launched 08:17:50.197681 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:50.737644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12719): Launched 08:17:51.067178 run osmo-stp_10.42.42.5(pid=12720): Launched 08:17:51.194221 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:51.761913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12722): Launched 08:17:52.094964 run osmo-msc_10.42.42.6(pid=12723): Launched 08:17:52.282165 run osmo-stp_10.42.42.5(pid=12720): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12720)] 08:17:52.421318 run osmo-stp_10.42.42.5(pid=12720): stdout: | (launched: 2022-12-09_08:17:51.006582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:52.561327 run osmo-stp_10.42.42.5(pid=12720): stderr: | 20221209081751197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081751197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081751197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081751198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081751198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081751198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081751198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:52.698993 run osmo-stp_10.42.42.5(pid=12720): stdout: | (launched: 2022-12-09_08:17:51.006582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:52.829815 run osmo-stp_10.42.42.5(pid=12720): stderr: | 20221209081751197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081751197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081751197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081751198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081751198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081751198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081751198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:52.986624 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12720): Process ended prematurely: osmo-stp_10.42.42.5(pid=12720) [trial-2356↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12720)] [trial-2356↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 08:17:52.995617 tst handover.py:18: Test FAILED (6.8 sec) 08:17:53.023061 run osmo-hlr_10.42.42.2(pid=12717): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12717)] 08:17:53.073498 run osmo-hlr_10.42.42.2(pid=12717): stdout: | (launched: 2022-12-09_08:17:50.008906) 08:17:53.125467 run osmo-hlr_10.42.42.2(pid=12717): stderr: | 20221209081750209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081750209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081750209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081750209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081750209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081750209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081750222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081750231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081750231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081750231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:53.197450 run osmo-msc_10.42.42.6(pid=12723): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12723)] 08:17:53.247452 run osmo-msc_10.42.42.6(pid=12723): stdout: | (launched: 2022-12-09_08:17:52.033893) 08:17:53.298868 run osmo-msc_10.42.42.6(pid=12723): stderr: | 20221209081752356 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081752356 DLGLOBAL DEBUG validating counter group 0x7f497cc84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081752356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081752356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081752356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081752356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081752358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081752359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081752359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081752359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:53.350618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12716): Terminating (SIGTERM) 08:17:53.392297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12719): Terminating (SIGTERM) 08:17:53.433858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12722): Terminating (SIGTERM) 08:17:53.476625 --- ParallelTerminationStrategy: PID 12716 died... 08:17:53.497130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12716): Terminated: ok {rc=0} 08:17:53.543956 --- ParallelTerminationStrategy: PID 12719 died... 08:17:53.564083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12719): Terminated: ok {rc=0} 08:17:53.610832 --- ParallelTerminationStrategy: PID 12722 died... 08:17:53.630628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12722): Terminated: ok {rc=0} 08:17:53.720124 bus /sierra_3: Setting Powered False 08:17:54.818810 bus /sierra_3: Setting Powered False 08:17:55.932403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:17:57.199997 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:57.205165 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:17:57.264872 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:17:57.292066 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:17:57.344472 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:17:57.407436 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:17:57.435613 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:17:57.986747 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:17:57.991886 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:58.003267 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:17:58.047003 tst handover.py: using LAC 20161 08:17:58.168831 tst handover.py: using RAC 16 08:17:58.291473 tst handover.py: using CellId 20161 08:17:58.415050 tst handover.py: using BVCI 20162 08:17:58.528275 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:17:58.577753 tst handover.py: using LAC 20162 08:17:58.700317 tst handover.py: using RAC 17 08:17:58.829054 tst handover.py: using CellId 20162 08:17:58.957362 tst handover.py: using BVCI 20163 08:17:59.078627 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:59.090764 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:59.102646 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:59.114574 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:59.126522 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:59.138423 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:17:59.255631 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:17:59.377472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:59.862018 run create_hlr_db(pid=12728): Launched 08:17:59.988892 bus /sierra_2: Setting Powered False 08:18:01.051888 run create_hlr_db(pid=12728): Terminated: ok {rc=0} 08:18:01.487370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12730): Launched 08:18:01.830816 run osmo-hlr_10.42.42.2(pid=12731): Launched 08:18:02.100444 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:02.669407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12733): Launched 08:18:02.998047 run osmo-stp_10.42.42.5(pid=12734): Launched 08:18:03.126522 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:03.693565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12736): Launched 08:18:04.023129 run osmo-msc_10.42.42.6(pid=12737): Launched 08:18:04.208448 run osmo-stp_10.42.42.5(pid=12734): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12734)] 08:18:04.347953 run osmo-stp_10.42.42.5(pid=12734): stdout: | (launched: 2022-12-09_08:18:02.937376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:04.487394 run osmo-stp_10.42.42.5(pid=12734): stderr: | 20221209081803130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081803130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081803131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081803131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081803131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081803131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081803132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:04.625267 run osmo-stp_10.42.42.5(pid=12734): stdout: | (launched: 2022-12-09_08:18:02.937376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:04.755821 run osmo-stp_10.42.42.5(pid=12734): stderr: | 20221209081803130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081803130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081803131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081803131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081803131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081803131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081803132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:04.912541 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12734): Process ended prematurely: osmo-stp_10.42.42.5(pid=12734) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12734)] [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 08:18:04.921589 tst handover.py:18: Test FAILED (6.9 sec) 08:18:04.948782 run osmo-hlr_10.42.42.2(pid=12731): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12731)] 08:18:04.998391 run osmo-hlr_10.42.42.2(pid=12731): stdout: | (launched: 2022-12-09_08:18:01.770608) 08:18:05.050662 run osmo-hlr_10.42.42.2(pid=12731): stderr: | 20221209081801976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081801976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081801976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081801976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081801976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081801976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081801991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081802007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081802007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081802007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:05.123324 run osmo-msc_10.42.42.6(pid=12737): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12737)] 08:18:05.173205 run osmo-msc_10.42.42.6(pid=12737): stdout: | (launched: 2022-12-09_08:18:03.962172) 08:18:05.225106 run osmo-msc_10.42.42.6(pid=12737): stderr: | 20221209081804283 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081804283 DLGLOBAL DEBUG validating counter group 0x7ff7b1623c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081804283 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081804283 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081804284 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081804284 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081804285 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081804286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081804286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081804286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:05.276630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12730): Terminating (SIGTERM) 08:18:05.318024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12733): Terminating (SIGTERM) 08:18:05.359676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12736): Terminating (SIGTERM) 08:18:05.401793 --- ParallelTerminationStrategy: PID 12730 died... 08:18:05.421908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12730): Terminated: ok {rc=0} 08:18:05.468093 --- ParallelTerminationStrategy: PID 12733 died... 08:18:05.487800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12733): Terminated: ok {rc=0} 08:18:05.533642 --- ParallelTerminationStrategy: PID 12736 died... 08:18:05.553054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12736): Terminated: ok {rc=0} 08:18:05.641922 bus /sierra_3: Setting Powered False 08:18:06.739311 bus /sierra_3: Setting Powered False 08:18:07.856604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 08:18:09.126919 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:09.131930 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:18:09.178703 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:18:09.205591 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:18:09.258558 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:18:09.305938 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:18:09.332768 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:18:09.884719 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 08:18:09.890046 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:09.901381 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 08:18:09.944546 tst handover.py: using LAC 20163 08:18:10.065957 tst handover.py: using RAC 18 08:18:10.186835 tst handover.py: using CellId 20163 08:18:10.310498 tst handover.py: using BVCI 20164 08:18:10.423707 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 08:18:10.459390 tst handover.py: using LAC 20164 08:18:10.579835 tst handover.py: using RAC 19 08:18:10.702181 tst handover.py: using CellId 20164 08:18:10.824860 tst handover.py: using BVCI 20165 08:18:10.936333 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:10.947925 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:10.959018 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:10.970221 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:10.981341 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:10.992413 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 08:18:11.114419 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 08:18:11.232621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:11.683623 run create_hlr_db(pid=12742): Launched 08:18:11.809615 bus /sierra_2: Setting Powered False 08:18:12.870398 run create_hlr_db(pid=12742): Terminated: ok {rc=0} 08:18:13.272063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12744): Launched 08:18:13.580343 run osmo-hlr_10.42.42.2(pid=12745): Launched 08:18:13.698687 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:14.217387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12747): Launched 08:18:14.524221 run osmo-stp_10.42.42.5(pid=12748): Launched 08:18:14.641513 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:15.171376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12750): Launched 08:18:15.479796 run osmo-msc_10.42.42.6(pid=12751): Launched 08:18:15.651748 run osmo-stp_10.42.42.5(pid=12748): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12748)] 08:18:15.781145 run osmo-stp_10.42.42.5(pid=12748): stdout: | (launched: 2022-12-09_08:18:14.467572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:15.935869 run osmo-stp_10.42.42.5(pid=12748): stderr: | 20221209081814638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081814638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081814638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081814639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081814639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081814639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081814639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:16.078353 run osmo-stp_10.42.42.5(pid=12748): stdout: | (launched: 2022-12-09_08:18:14.467572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:16.215019 run osmo-stp_10.42.42.5(pid=12748): stderr: | 20221209081814638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081814638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081814638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081814639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081814639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081814639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081814639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:16.377930 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12748): Process ended prematurely: osmo-stp_10.42.42.5(pid=12748) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12748)] [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 08:18:16.387898 tst handover.py:18: Test FAILED (6.5 sec) 08:18:16.419148 run osmo-hlr_10.42.42.2(pid=12745): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12745)] 08:18:16.471986 run osmo-hlr_10.42.42.2(pid=12745): stdout: | (launched: 2022-12-09_08:18:13.522510) 08:18:16.527434 run osmo-hlr_10.42.42.2(pid=12745): stderr: | 20221209081813697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081813697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081813697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081813697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081813698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081813698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081813708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081813718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081813718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081813718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:16.603797 run osmo-msc_10.42.42.6(pid=12751): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12751)] 08:18:16.657641 run osmo-msc_10.42.42.6(pid=12751): stdout: | (launched: 2022-12-09_08:18:15.422521) 08:18:16.712223 run osmo-msc_10.42.42.6(pid=12751): stderr: | 20221209081815696 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081815696 DLGLOBAL DEBUG validating counter group 0x7fda72fb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081815696 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081815696 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081815696 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081815696 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081815698 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081815698 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081815699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081815699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:16.765896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12744): Terminating (SIGTERM) 08:18:16.811371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12747): Terminating (SIGTERM) 08:18:16.857969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12750): Terminating (SIGTERM) 08:18:16.904768 --- ParallelTerminationStrategy: PID 12744 died... 08:18:16.925776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12744): Terminated: ok {rc=0} 08:18:16.975438 --- ParallelTerminationStrategy: PID 12747 died... 08:18:16.997460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12747): Terminated: ok {rc=0} 08:18:17.047185 --- ParallelTerminationStrategy: PID 12750 died... 08:18:17.069250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12750): Terminated: ok {rc=0} 08:18:17.164068 bus /sierra_3: Setting Powered False 08:18:18.263645 bus /sierra_3: Setting Powered False 08:18:19.379011 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 08:18:20.640157 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:20.646025 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:18:20.706872 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:18:20.735582 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:18:20.788543 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:18:20.850733 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:18:20.879637 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:18:21.432853 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 08:18:21.438533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:21.450354 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:18:21.496198 tst handover.py: using LAC 20165 08:18:21.627377 tst handover.py: using RAC 20 08:18:21.755280 tst handover.py: using CellId 20165 08:18:21.883578 tst handover.py: using BVCI 20166 08:18:21.998619 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:18:22.052110 tst handover.py: using LAC 20166 08:18:22.174594 tst handover.py: using RAC 21 08:18:22.295544 tst handover.py: using CellId 20166 08:18:22.417614 tst handover.py: using BVCI 20167 08:18:22.529870 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:22.541282 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:22.552476 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:22.564194 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:22.575462 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:22.587745 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:18:22.708670 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:18:22.827143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:23.279395 run create_hlr_db(pid=12756): Launched 08:18:23.409097 bus /sierra_2: Setting Powered False 08:18:24.473695 run create_hlr_db(pid=12756): Terminated: ok {rc=0} 08:18:24.903317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12758): Launched 08:18:25.235684 run osmo-hlr_10.42.42.2(pid=12759): Launched 08:18:25.363416 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:25.904545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12761): Launched 08:18:26.236239 run osmo-stp_10.42.42.5(pid=12762): Launched 08:18:26.363763 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:26.932365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12764): Launched 08:18:27.264567 run osmo-msc_10.42.42.6(pid=12765): Launched 08:18:27.450973 run osmo-stp_10.42.42.5(pid=12762): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12762)] 08:18:27.591655 run osmo-stp_10.42.42.5(pid=12762): stdout: | (launched: 2022-12-09_08:18:26.175581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:27.731013 run osmo-stp_10.42.42.5(pid=12762): stderr: | 20221209081826366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081826366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081826366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081826366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081826367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081826367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081826367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:27.870253 run osmo-stp_10.42.42.5(pid=12762): stdout: | (launched: 2022-12-09_08:18:26.175581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:28.000805 run osmo-stp_10.42.42.5(pid=12762): stderr: | 20221209081826366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081826366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081826366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081826366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081826367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081826367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081826367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:28.158672 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12762): Process ended prematurely: osmo-stp_10.42.42.5(pid=12762) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12762)] [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 08:18:28.167936 tst handover.py:18: Test FAILED (6.7 sec) 08:18:28.195508 run osmo-hlr_10.42.42.2(pid=12759): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12759)] 08:18:28.246185 run osmo-hlr_10.42.42.2(pid=12759): stdout: | (launched: 2022-12-09_08:18:25.175011) 08:18:28.297971 run osmo-hlr_10.42.42.2(pid=12759): stderr: | 20221209081825371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081825371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081825371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081825372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081825372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081825372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081825384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081825393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081825393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081825393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:28.370283 run osmo-msc_10.42.42.6(pid=12765): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12765)] 08:18:28.420093 run osmo-msc_10.42.42.6(pid=12765): stdout: | (launched: 2022-12-09_08:18:27.203591) 08:18:28.471877 run osmo-msc_10.42.42.6(pid=12765): stderr: | 20221209081827526 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081827526 DLGLOBAL DEBUG validating counter group 0x7fb2b8744c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081827526 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081827526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081827526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081827526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081827528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081827529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081827529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081827529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:28.523825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12758): Terminating (SIGTERM) 08:18:28.565200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12761): Terminating (SIGTERM) 08:18:28.606566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12764): Terminating (SIGTERM) 08:18:28.648401 --- ParallelTerminationStrategy: PID 12758 died... 08:18:28.668771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12758): Terminated: ok {rc=0} 08:18:28.715158 --- ParallelTerminationStrategy: PID 12761 died... 08:18:28.735273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12761): Terminated: ok {rc=0} 08:18:28.781562 --- ParallelTerminationStrategy: PID 12764 died... 08:18:28.801452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12764): Terminated: ok {rc=0} 08:18:28.888670 bus /sierra_3: Setting Powered False 08:18:29.986097 bus /sierra_3: Setting Powered False 08:18:31.098286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 08:18:32.374296 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:32.379829 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:18:32.438771 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:18:32.466496 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:18:32.520133 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:18:32.581132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:18:32.609133 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:18:33.164166 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 08:18:33.169881 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:18:33.181664 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:18:33.226308 tst handover.py: using LAC 20167 08:18:33.359262 tst handover.py: using RAC 22 08:18:33.489186 tst handover.py: using CellId 20167 08:18:33.619617 tst handover.py: using BVCI 20168 08:18:33.739518 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:18:33.792874 tst handover.py: using LAC 20168 08:18:33.913384 tst handover.py: using RAC 23 08:18:34.032577 tst handover.py: using CellId 20168 08:18:34.151964 tst handover.py: using BVCI 20169 08:18:34.273109 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:18:34.285065 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:18:34.296721 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:18:34.308564 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:18:34.320700 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:18:34.332478 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:18:34.449700 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:18:34.570515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:35.058023 run create_hlr_db(pid=12770): Launched 08:18:35.185904 bus /sierra_2: Setting Powered False 08:18:36.250386 run create_hlr_db(pid=12770): Terminated: ok {rc=0} 08:18:36.663606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12772): Launched 08:18:36.971176 run osmo-hlr_10.42.42.2(pid=12773): Launched 08:18:37.088753 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:37.593673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12775): Launched 08:18:37.902203 run osmo-stp_10.42.42.5(pid=12776): Launched 08:18:38.024553 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:38.556351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12778): Launched 08:18:38.864335 run osmo-msc_10.42.42.6(pid=12779): Launched 08:18:39.036642 run osmo-stp_10.42.42.5(pid=12776): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12776)] 08:18:39.165777 run osmo-stp_10.42.42.5(pid=12776): stdout: | (launched: 2022-12-09_08:18:37.845165) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:39.296326 run osmo-stp_10.42.42.5(pid=12776): stderr: | 20221209081838018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081838018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081838018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081838019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081838019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081838019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081838019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:39.423884 run osmo-stp_10.42.42.5(pid=12776): stdout: | (launched: 2022-12-09_08:18:37.845165) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:39.546047 run osmo-stp_10.42.42.5(pid=12776): stderr: | 20221209081838018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081838018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081838018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081838019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081838019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081838019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081838019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:39.691307 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12776): Process ended prematurely: osmo-stp_10.42.42.5(pid=12776) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12776)] [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 08:18:39.699625 tst handover.py:18: Test FAILED (6.5 sec) 08:18:39.725525 run osmo-hlr_10.42.42.2(pid=12773): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12773)] 08:18:39.772329 run osmo-hlr_10.42.42.2(pid=12773): stdout: | (launched: 2022-12-09_08:18:36.914462) 08:18:39.821146 run osmo-hlr_10.42.42.2(pid=12773): stderr: | 20221209081837090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081837090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081837090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081837090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081837090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081837090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081837102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081837110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081837110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081837110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:39.889152 run osmo-msc_10.42.42.6(pid=12779): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12779)] 08:18:39.936353 run osmo-msc_10.42.42.6(pid=12779): stdout: | (launched: 2022-12-09_08:18:38.807514) 08:18:39.985136 run osmo-msc_10.42.42.6(pid=12779): stderr: | 20221209081839076 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081839076 DLGLOBAL DEBUG validating counter group 0x7f2a6b982c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081839077 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081839077 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081839077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081839077 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081839079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081839079 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081839080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081839080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:40.034370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12772): Terminating (SIGTERM) 08:18:40.073207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12775): Terminating (SIGTERM) 08:18:40.111990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12778): Terminating (SIGTERM) 08:18:40.151181 --- ParallelTerminationStrategy: PID 12772 died... 08:18:40.170119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12772): Terminated: ok {rc=0} 08:18:40.213231 --- ParallelTerminationStrategy: PID 12775 died... 08:18:40.231431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12775): Terminated: ok {rc=0} 08:18:40.274633 --- ParallelTerminationStrategy: PID 12778 died... 08:18:40.293314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12778): Terminated: ok {rc=0} 08:18:40.380331 bus /sierra_3: Setting Powered False 08:18:41.481489 bus /sierra_3: Setting Powered False 08:18:42.598955 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 08:18:43.870040 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:43.875006 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:18:43.926227 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:18:43.952872 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:18:44.004368 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:18:44.055681 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:18:44.082512 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:18:44.639510 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 08:18:44.646009 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:44.657922 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 08:18:44.707279 tst handover.py: using LAC 20169 08:18:44.829293 tst handover.py: using RAC 24 08:18:44.950532 tst handover.py: using CellId 20169 08:18:45.071311 tst handover.py: using BVCI 20170 08:18:45.184244 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 08:18:45.218297 tst handover.py: using LAC 20170 08:18:45.337104 tst handover.py: using RAC 25 08:18:45.457122 tst handover.py: using CellId 20170 08:18:45.577096 tst handover.py: using BVCI 20171 08:18:45.689229 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:45.700384 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:45.711474 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:45.722500 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:45.733494 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:45.744467 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 08:18:45.884319 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 08:18:46.041117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:46.574414 run create_hlr_db(pid=12784): Launched 08:18:46.738896 bus /sierra_2: Setting Powered False 08:18:47.799664 run create_hlr_db(pid=12784): Terminated: ok {rc=0} 08:18:48.222273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12786): Launched 08:18:48.553543 run osmo-hlr_10.42.42.2(pid=12787): Launched 08:18:48.680222 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:49.221690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12789): Launched 08:18:49.552238 run osmo-stp_10.42.42.5(pid=12790): Launched 08:18:49.680877 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:50.248734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12792): Launched 08:18:50.580120 run osmo-msc_10.42.42.6(pid=12793): Launched 08:18:50.768669 run osmo-stp_10.42.42.5(pid=12790): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12790)] 08:18:50.907801 run osmo-stp_10.42.42.5(pid=12790): stdout: | (launched: 2022-12-09_08:18:49.491556) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:51.046975 run osmo-stp_10.42.42.5(pid=12790): stderr: | 20221209081849685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081849685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081849685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081849686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081849686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081849686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081849686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:51.185700 run osmo-stp_10.42.42.5(pid=12790): stdout: | (launched: 2022-12-09_08:18:49.491556) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:51.317041 run osmo-stp_10.42.42.5(pid=12790): stderr: | 20221209081849685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081849685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081849685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081849686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081849686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081849686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081849686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:51.473574 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12790): Process ended prematurely: osmo-stp_10.42.42.5(pid=12790) [trial-2356↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12790)] [trial-2356↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 08:18:51.482530 tst handover.py:18: Test FAILED (6.8 sec) 08:18:51.510035 run osmo-hlr_10.42.42.2(pid=12787): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12787)] 08:18:51.560022 run osmo-hlr_10.42.42.2(pid=12787): stdout: | (launched: 2022-12-09_08:18:48.492719) 08:18:51.611121 run osmo-hlr_10.42.42.2(pid=12787): stderr: | 20221209081848693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081848693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081848693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081848693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081848693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081848693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081848706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081848714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081848714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081848714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:51.682566 run osmo-msc_10.42.42.6(pid=12793): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12793)] 08:18:51.732584 run osmo-msc_10.42.42.6(pid=12793): stdout: | (launched: 2022-12-09_08:18:50.519313) 08:18:51.783887 run osmo-msc_10.42.42.6(pid=12793): stderr: | 20221209081850843 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081850843 DLGLOBAL DEBUG validating counter group 0x7ff24c474c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081850843 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081850843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081850843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081850844 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081850845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081850846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081850846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081850846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:51.836546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12786): Terminating (SIGTERM) 08:18:51.877805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12789): Terminating (SIGTERM) 08:18:51.919936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12792): Terminating (SIGTERM) 08:18:51.962535 --- ParallelTerminationStrategy: PID 12786 died... 08:18:51.982638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12786): Terminated: ok {rc=0} 08:18:52.029390 --- ParallelTerminationStrategy: PID 12789 died... 08:18:52.049489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12789): Terminated: ok {rc=0} 08:18:52.096143 --- ParallelTerminationStrategy: PID 12792 died... 08:18:52.115899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12792): Terminated: ok {rc=0} 08:18:52.203556 bus /sierra_3: Setting Powered False 08:18:53.302719 bus /sierra_3: Setting Powered False 08:18:54.417406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 08:18:55.683827 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:55.690167 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:18:55.754380 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:18:55.781640 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:18:55.832416 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:18:55.899381 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:18:55.926117 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:18:56.478008 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 08:18:56.483585 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:56.494820 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:18:56.543599 tst handover.py: using LAC 20171 08:18:56.665404 tst handover.py: using RAC 26 08:18:56.794543 tst handover.py: using CellId 20171 08:18:56.923456 tst handover.py: using BVCI 20172 08:18:57.045301 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:18:57.094204 tst handover.py: using LAC 20172 08:18:57.224285 tst handover.py: using RAC 27 08:18:57.351453 tst handover.py: using CellId 20172 08:18:57.480217 tst handover.py: using BVCI 20173 08:18:57.610739 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:57.622532 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:57.634144 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:57.645622 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:57.657032 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:57.668499 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:18:57.793320 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:18:57.910991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:58.362347 run create_hlr_db(pid=12798): Launched 08:18:58.489095 bus /sierra_2: Setting Powered False 08:18:59.550021 run create_hlr_db(pid=12798): Terminated: ok {rc=0} 08:18:59.951037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12800): Launched 08:19:00.260180 run osmo-hlr_10.42.42.2(pid=12801): Launched 08:19:00.376436 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:00.896291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12803): Launched 08:19:01.229649 run osmo-stp_10.42.42.5(pid=12804): Launched 08:19:01.499958 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:02.037789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12806): Launched 08:19:02.362294 run osmo-msc_10.42.42.6(pid=12807): Launched 08:19:02.536255 run osmo-stp_10.42.42.5(pid=12804): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12804)] 08:19:02.666545 run osmo-stp_10.42.42.5(pid=12804): stdout: | (launched: 2022-12-09_08:19:01.167681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:02.797147 run osmo-stp_10.42.42.5(pid=12804): stderr: | 20221209081901364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081901365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081901365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081901365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081901366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081901366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081901366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:02.924871 run osmo-stp_10.42.42.5(pid=12804): stdout: | (launched: 2022-12-09_08:19:01.167681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:03.046872 run osmo-stp_10.42.42.5(pid=12804): stderr: | 20221209081901364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081901365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081901365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081901365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081901366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081901366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081901366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:03.192425 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12804): Process ended prematurely: osmo-stp_10.42.42.5(pid=12804) [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12804)] [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 08:19:03.200747 tst handover.py:18: Test FAILED (6.7 sec) 08:19:03.226627 run osmo-hlr_10.42.42.2(pid=12801): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12801)] 08:19:03.273435 run osmo-hlr_10.42.42.2(pid=12801): stdout: | (launched: 2022-12-09_08:19:00.203435) 08:19:03.322280 run osmo-hlr_10.42.42.2(pid=12801): stderr: | 20221209081900377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081900377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081900377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081900377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081900378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081900378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081900393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081900404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081900404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081900404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:03.390556 run osmo-msc_10.42.42.6(pid=12807): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12807)] 08:19:03.437720 run osmo-msc_10.42.42.6(pid=12807): stdout: | (launched: 2022-12-09_08:19:02.304810) 08:19:03.486255 run osmo-msc_10.42.42.6(pid=12807): stderr: | 20221209081902579 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081902579 DLGLOBAL DEBUG validating counter group 0x7f4e84e5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081902579 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081902579 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081902579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081902580 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081902581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081902582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081902582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081902582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:03.535032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12800): Terminating (SIGTERM) 08:19:03.573959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12803): Terminating (SIGTERM) 08:19:03.613082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12806): Terminating (SIGTERM) 08:19:03.652335 --- ParallelTerminationStrategy: PID 12800 died... 08:19:03.671198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12800): Terminated: ok {rc=0} 08:19:03.714391 --- ParallelTerminationStrategy: PID 12803 died... 08:19:03.733308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12803): Terminated: ok {rc=0} 08:19:03.776493 --- ParallelTerminationStrategy: PID 12806 died... 08:19:03.795359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12806): Terminated: ok {rc=0} 08:19:03.880654 bus /sierra_3: Setting Powered False 08:19:04.979438 bus /sierra_3: Setting Powered False 08:19:06.094081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 08:19:07.372691 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:07.378638 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:19:07.443638 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:19:07.472528 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:19:07.527627 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:19:07.594888 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:19:07.622993 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:19:08.176249 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 08:19:08.182081 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:08.193876 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:08.245283 tst handover.py: using LAC 20173 08:19:08.377268 tst handover.py: using RAC 28 08:19:08.507468 tst handover.py: using CellId 20173 08:19:08.635812 tst handover.py: using BVCI 20174 08:19:08.755695 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:08.805379 tst handover.py: using LAC 20174 08:19:08.936025 tst handover.py: using RAC 29 08:19:09.064117 tst handover.py: using CellId 20174 08:19:09.186671 tst handover.py: using BVCI 20175 08:19:09.300104 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:09.311446 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:09.322612 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:09.333721 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:09.344897 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:09.355794 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:09.478437 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:09.602796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:10.086009 run create_hlr_db(pid=12813): Launched 08:19:10.213461 bus /sierra_2: Setting Powered False 08:19:11.276562 run create_hlr_db(pid=12813): Terminated: ok {rc=0} 08:19:11.706382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12815): Launched 08:19:12.039175 run osmo-hlr_10.42.42.2(pid=12816): Launched 08:19:12.167206 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:12.710124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12818): Launched 08:19:13.040334 run osmo-stp_10.42.42.5(pid=12819): Launched 08:19:13.169165 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:13.736430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12821): Launched 08:19:14.067448 run osmo-msc_10.42.42.6(pid=12822): Launched 08:19:14.253274 run osmo-stp_10.42.42.5(pid=12819): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12819)] 08:19:14.391934 run osmo-stp_10.42.42.5(pid=12819): stdout: | (launched: 2022-12-09_08:19:12.979305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:14.531203 run osmo-stp_10.42.42.5(pid=12819): stderr: | 20221209081913171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081913171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081913171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081913171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081913172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081913172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081913172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:14.668888 run osmo-stp_10.42.42.5(pid=12819): stdout: | (launched: 2022-12-09_08:19:12.979305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:14.799543 run osmo-stp_10.42.42.5(pid=12819): stderr: | 20221209081913171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081913171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081913171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081913171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081913172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081913172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081913172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:14.956331 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12819): Process ended prematurely: osmo-stp_10.42.42.5(pid=12819) [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12819)] [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 08:19:14.965484 tst handover.py:18: Test FAILED (6.8 sec) 08:19:14.992796 run osmo-hlr_10.42.42.2(pid=12816): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12816)] 08:19:15.042810 run osmo-hlr_10.42.42.2(pid=12816): stdout: | (launched: 2022-12-09_08:19:11.977982) 08:19:15.094795 run osmo-hlr_10.42.42.2(pid=12816): stderr: | 20221209081912175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081912175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081912175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081912175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081912175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081912175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081912187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081912196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081912196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081912196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:15.166954 run osmo-msc_10.42.42.6(pid=12822): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12822)] 08:19:15.217150 run osmo-msc_10.42.42.6(pid=12822): stdout: | (launched: 2022-12-09_08:19:14.006660) 08:19:15.268297 run osmo-msc_10.42.42.6(pid=12822): stderr: | 20221209081914326 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081914327 DLGLOBAL DEBUG validating counter group 0x7f5182702c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081914327 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081914327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081914327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081914327 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081914329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081914329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081914330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081914330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:15.320063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12815): Terminating (SIGTERM) 08:19:15.361675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12818): Terminating (SIGTERM) 08:19:15.403041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12821): Terminating (SIGTERM) 08:19:15.445022 --- ParallelTerminationStrategy: PID 12815 died... 08:19:15.465403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12815): Terminated: ok {rc=0} 08:19:15.511539 --- ParallelTerminationStrategy: PID 12818 died... 08:19:15.531387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12818): Terminated: ok {rc=0} 08:19:15.577430 --- ParallelTerminationStrategy: PID 12821 died... 08:19:15.597038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12821): Terminated: ok {rc=0} 08:19:15.684739 bus /sierra_3: Setting Powered False 08:19:16.788294 bus /sierra_3: Setting Powered False 08:19:17.915131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 08:19:19.192153 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:19.198036 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:19:19.251105 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:19:19.279871 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:19:19.333799 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:19:19.387152 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:19:19.415392 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:19:19.969904 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 08:19:19.975515 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:19.987085 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:19:20.022231 tst handover.py: using LAC 20175 08:19:20.155726 tst handover.py: using RAC 30 08:19:20.284545 tst handover.py: using CellId 20175 08:19:20.412655 tst handover.py: using BVCI 20176 08:19:20.533730 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:19:20.583248 tst handover.py: using LAC 20176 08:19:20.714103 tst handover.py: using RAC 31 08:19:20.841623 tst handover.py: using CellId 20176 08:19:20.964431 tst handover.py: using BVCI 20177 08:19:21.076831 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:21.087884 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:21.099310 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:21.110064 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:21.120820 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:21.131500 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:19:21.253500 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:19:21.373260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:21.858476 run create_hlr_db(pid=12827): Launched 08:19:21.986030 bus /sierra_2: Setting Powered False 08:19:23.050288 run create_hlr_db(pid=12827): Terminated: ok {rc=0} 08:19:23.462934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12829): Launched 08:19:23.771039 run osmo-hlr_10.42.42.2(pid=12830): Launched 08:19:23.888800 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:24.391826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12832): Launched 08:19:24.701161 run osmo-stp_10.42.42.5(pid=12833): Launched 08:19:24.819225 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:25.352827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12835): Launched 08:19:25.662703 run osmo-msc_10.42.42.6(pid=12836): Launched 08:19:25.835670 run osmo-stp_10.42.42.5(pid=12833): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12833)] 08:19:25.966184 run osmo-stp_10.42.42.5(pid=12833): stdout: | (launched: 2022-12-09_08:19:24.643944) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:26.096268 run osmo-stp_10.42.42.5(pid=12833): stderr: | 20221209081924816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081924816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081924816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081924817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081924817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081924817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081924817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:26.225395 run osmo-stp_10.42.42.5(pid=12833): stdout: | (launched: 2022-12-09_08:19:24.643944) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:26.347993 run osmo-stp_10.42.42.5(pid=12833): stderr: | 20221209081924816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081924816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081924816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081924817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081924817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081924817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081924817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:26.494562 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12833): Process ended prematurely: osmo-stp_10.42.42.5(pid=12833) [trial-2356↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12833)] [trial-2356↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 08:19:26.502814 tst handover.py:18: Test FAILED (6.5 sec) 08:19:26.528925 run osmo-hlr_10.42.42.2(pid=12830): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12830)] 08:19:26.576446 run osmo-hlr_10.42.42.2(pid=12830): stdout: | (launched: 2022-12-09_08:19:23.714030) 08:19:26.625176 run osmo-hlr_10.42.42.2(pid=12830): stderr: | 20221209081923891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081923891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081923891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081923891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081923891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081923891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081923902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081923911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081923911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081923911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:26.693884 run osmo-msc_10.42.42.6(pid=12836): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12836)] 08:19:26.741081 run osmo-msc_10.42.42.6(pid=12836): stdout: | (launched: 2022-12-09_08:19:25.605420) 08:19:26.789642 run osmo-msc_10.42.42.6(pid=12836): stderr: | 20221209081925877 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081925877 DLGLOBAL DEBUG validating counter group 0x7f8eb5eaec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081925877 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081925877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081925878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081925878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081925879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081925880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081925880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081925880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:26.838660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12829): Terminating (SIGTERM) 08:19:26.877592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12832): Terminating (SIGTERM) 08:19:26.917409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12835): Terminating (SIGTERM) 08:19:26.957254 --- ParallelTerminationStrategy: PID 12829 died... 08:19:26.976296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12829): Terminated: ok {rc=0} 08:19:27.020083 --- ParallelTerminationStrategy: PID 12832 died... 08:19:27.038745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12832): Terminated: ok {rc=0} 08:19:27.082377 --- ParallelTerminationStrategy: PID 12835 died... 08:19:27.100798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12835): Terminated: ok {rc=0} 08:19:27.184165 bus /sierra_3: Setting Powered False 08:19:28.282168 bus /sierra_3: Setting Powered False 08:19:29.398018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 08:19:30.656692 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:30.661922 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:19:30.712654 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:19:30.739526 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:19:30.790455 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:19:30.847845 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:19:30.890733 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:19:31.457526 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 08:19:31.467560 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:31.484773 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:31.532558 tst handover.py: using LAC 20177 08:19:31.683627 tst handover.py: using RAC 32 08:19:31.844214 tst handover.py: using CellId 20177 08:19:31.976554 tst handover.py: using BVCI 20178 08:19:32.142661 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:32.196499 tst handover.py: using LAC 20178 08:19:32.330739 tst handover.py: using RAC 33 08:19:32.459174 tst handover.py: using CellId 20178 08:19:32.588237 tst handover.py: using BVCI 20179 08:19:32.703029 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:32.714589 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:32.725813 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:32.737205 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:32.748470 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:32.759892 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:32.884833 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:33.005441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:33.490966 run create_hlr_db(pid=12841): Launched 08:19:33.618317 bus /sierra_2: Setting Powered False 08:19:34.683131 run create_hlr_db(pid=12841): Terminated: ok {rc=0} 08:19:35.113182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12843): Launched 08:19:35.443449 run osmo-hlr_10.42.42.2(pid=12844): Launched 08:19:35.570655 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:36.114408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12846): Launched 08:19:36.445350 run osmo-stp_10.42.42.5(pid=12847): Launched 08:19:36.571708 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:37.143097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12849): Launched 08:19:37.473345 run osmo-msc_10.42.42.6(pid=12850): Launched 08:19:37.659711 run osmo-stp_10.42.42.5(pid=12847): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12847)] 08:19:37.798517 run osmo-stp_10.42.42.5(pid=12847): stdout: | (launched: 2022-12-09_08:19:36.384555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:37.938257 run osmo-stp_10.42.42.5(pid=12847): stderr: | 20221209081936576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081936577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081936577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081936577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081936578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081936578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081936578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:38.075757 run osmo-stp_10.42.42.5(pid=12847): stdout: | (launched: 2022-12-09_08:19:36.384555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:38.207551 run osmo-stp_10.42.42.5(pid=12847): stderr: | 20221209081936576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081936577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081936577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081936577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081936578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081936578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081936578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:38.364410 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12847): Process ended prematurely: osmo-stp_10.42.42.5(pid=12847) [trial-2356↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12847)] [trial-2356↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 08:19:38.373643 tst handover.py:18: Test FAILED (6.9 sec) 08:19:38.401242 run osmo-hlr_10.42.42.2(pid=12844): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12844)] 08:19:38.451895 run osmo-hlr_10.42.42.2(pid=12844): stdout: | (launched: 2022-12-09_08:19:35.382369) 08:19:38.504357 run osmo-hlr_10.42.42.2(pid=12844): stderr: | 20221209081935580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081935580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081935580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081935581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081935581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081935581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081935592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081935602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081935603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081935603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:38.577029 run osmo-msc_10.42.42.6(pid=12850): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12850)] 08:19:38.627372 run osmo-msc_10.42.42.6(pid=12850): stdout: | (launched: 2022-12-09_08:19:37.412345) 08:19:38.679341 run osmo-msc_10.42.42.6(pid=12850): stderr: | 20221209081937735 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081937735 DLGLOBAL DEBUG validating counter group 0x7f7c29fe8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081937735 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081937736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081937736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081937736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081937738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081937738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081937738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081937738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:38.731501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12843): Terminating (SIGTERM) 08:19:38.773188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12846): Terminating (SIGTERM) 08:19:38.815353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12849): Terminating (SIGTERM) 08:19:38.857681 --- ParallelTerminationStrategy: PID 12843 died... 08:19:38.877730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12843): Terminated: ok {rc=0} 08:19:38.924595 --- ParallelTerminationStrategy: PID 12846 died... 08:19:38.944601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12846): Terminated: ok {rc=0} 08:19:38.991037 --- ParallelTerminationStrategy: PID 12849 died... 08:19:39.011053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12849): Terminated: ok {rc=0} 08:19:39.099912 bus /sierra_3: Setting Powered False 08:19:40.199048 bus /sierra_3: Setting Powered False 08:19:41.315521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2356 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 08:19:42.574415 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:42.579985 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:19:42.644286 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:19:42.673290 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:19:42.726812 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:19:42.792676 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:19:42.820759 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:19:43.372238 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2356 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 08:19:43.377683 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:43.389124 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:43.437706 tst handover.py: using LAC 20179 08:19:43.568564 tst handover.py: using RAC 34 08:19:43.699742 tst handover.py: using CellId 20179 08:19:43.830071 tst handover.py: using BVCI 20180 08:19:43.950224 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:43.999118 tst handover.py: using LAC 20180 08:19:44.130042 tst handover.py: using RAC 35 08:19:44.261334 tst handover.py: using CellId 20180 08:19:44.387194 tst handover.py: using BVCI 20181 08:19:44.500478 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:44.511647 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:44.522542 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:44.533605 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:44.544477 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:44.555209 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:44.676633 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:44.800397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:45.285551 run create_hlr_db(pid=12857): Launched 08:19:45.412693 bus /sierra_2: Setting Powered False 08:19:46.481979 run create_hlr_db(pid=12857): Terminated: ok {rc=0} 08:19:46.978914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12859): Launched 08:19:47.326370 run osmo-hlr_10.42.42.2(pid=12860): Launched 08:19:47.456812 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:48.000300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12862): Launched 08:19:48.334323 run osmo-stp_10.42.42.5(pid=12863): Launched 08:19:48.462965 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:49.032941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12865): Launched 08:19:49.366183 run osmo-msc_10.42.42.6(pid=12866): Launched 08:19:49.551579 run osmo-stp_10.42.42.5(pid=12863): ERR: Terminated: ERROR {rc=1} [trial-2356↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12863)] 08:19:49.690846 run osmo-stp_10.42.42.5(pid=12863): stdout: | (launched: 2022-12-09_08:19:48.273618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:49.830699 run osmo-stp_10.42.42.5(pid=12863): stderr: | 20221209081948466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081948466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081948466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081948466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081948467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081948467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081948467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:49.968218 run osmo-stp_10.42.42.5(pid=12863): stdout: | (launched: 2022-12-09_08:19:48.273618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:50.099938 run osmo-stp_10.42.42.5(pid=12863): stderr: | 20221209081948466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209081948466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209081948466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209081948466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209081948467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209081948467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209081948467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:50.257792 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12863): Process ended prematurely: osmo-stp_10.42.42.5(pid=12863) [trial-2356↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12863)] [trial-2356↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 08:19:50.266720 tst handover.py:18: Test FAILED (6.9 sec) 08:19:50.294108 run osmo-hlr_10.42.42.2(pid=12860): ERR: Terminated: ERROR {rc=237} [trial-2356↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12860)] 08:19:50.344093 run osmo-hlr_10.42.42.2(pid=12860): stdout: | (launched: 2022-12-09_08:19:47.265621) 08:19:50.395998 run osmo-hlr_10.42.42.2(pid=12860): stderr: | 20221209081947462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209081947462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209081947462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209081947462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209081947462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209081947462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209081947474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209081947483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209081947484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209081947484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:50.467858 run osmo-msc_10.42.42.6(pid=12866): ERR: Terminated: ERROR {rc=2} [trial-2356↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12866)] 08:19:50.517785 run osmo-msc_10.42.42.6(pid=12866): stdout: | (launched: 2022-12-09_08:19:49.305183) 08:19:50.569329 run osmo-msc_10.42.42.6(pid=12866): stderr: | 20221209081949627 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209081949627 DLGLOBAL DEBUG validating counter group 0x7f15341e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209081949627 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209081949627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209081949627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209081949627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209081949629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209081949629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209081949630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209081949630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:50.621381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12859): Terminating (SIGTERM) 08:19:50.663724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12862): Terminating (SIGTERM) 08:19:50.705110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12865): Terminating (SIGTERM) 08:19:50.747193 --- ParallelTerminationStrategy: PID 12859 died... 08:19:50.767045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12859): Terminated: ok {rc=0} 08:19:50.812910 --- ParallelTerminationStrategy: PID 12862 died... 08:19:50.832432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12862): Terminated: ok {rc=0} 08:19:50.878989 --- ParallelTerminationStrategy: PID 12865 died... 08:19:50.898954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12865): Terminated: ok {rc=0} 08:19:50.987362 bus /sierra_3: Setting Powered False 08:19:52.086504 bus /sierra_3: Setting Powered False 08:19:53.206574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2356 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 08:19:54.487816 tst trial-2356: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356/run.2022-12-09_06-55-12/trial-2356.xml -------------------------------------------------------------------------------------------- trial-2356 FAIL -------------------------------------------------------------------------------------------- 08:19:56.418810 tst trial-2356: trial-2356: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=4670): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4670) [trial-2356↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4670)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=4684): Process ended prematurely: osmo-stp_10.42.42.5(pid=4684) [trial-2356↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4684)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4693): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4693) [trial-2356↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4693)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4703): Process ended prematurely: osmo-stp_10.42.42.5(pid=4703) [trial-2356↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4703)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4717): Process ended prematurely: osmo-stp_10.42.42.5(pid=4717) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4717)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4728): Process ended prematurely: osmo-stp_10.42.42.5(pid=4728) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4728)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4742): Process ended prematurely: osmo-stp_10.42.42.5(pid=4742) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4742)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4754): Process ended prematurely: osmo-stp_10.42.42.5(pid=4754) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4754)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4769): Process ended prematurely: osmo-stp_10.42.42.5(pid=4769) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4769)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4780): Process ended prematurely: osmo-stp_10.42.42.5(pid=4780) [trial-2356↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4780)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4794): Process ended prematurely: osmo-stp_10.42.42.5(pid=4794) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4794)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4805): Process ended prematurely: osmo-stp_10.42.42.5(pid=4805) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4805)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4819): Process ended prematurely: osmo-stp_10.42.42.5(pid=4819) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4819)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4831): Process ended prematurely: osmo-stp_10.42.42.5(pid=4831) [trial-2356↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4831)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4845): Process ended prematurely: osmo-stp_10.42.42.5(pid=4845) [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4845)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4859): Process ended prematurely: osmo-stp_10.42.42.5(pid=4859) [trial-2356↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4859)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4873): Process ended prematurely: osmo-stp_10.42.42.5(pid=4873) [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4873)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4884): Process ended prematurely: osmo-stp_10.42.42.5(pid=4884) [trial-2356↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4884)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4900): Process ended prematurely: osmo-stp_10.42.42.5(pid=4900) [trial-2356↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4900)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4911): Process ended prematurely: osmo-stp_10.42.42.5(pid=4911) [trial-2356↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4911)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=4930): Process ended prematurely: osmo-stp_10.42.42.5(pid=4930) [trial-2356↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4942): Process ended prematurely: osmo-stp_10.42.42.5(pid=4942) [trial-2356↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4942)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=4960): Process ended prematurely: osmo-stp_10.42.42.5(pid=4960) [trial-2356↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4960)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4970): Process ended prematurely: osmo-stp_10.42.42.5(pid=4970) [trial-2356↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4970)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4980): Process ended prematurely: osmo-stp_10.42.42.5(pid=4980) [trial-2356↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4980)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4998): Process ended prematurely: osmo-stp_10.42.42.5(pid=4998) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4998)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5010): Process ended prematurely: osmo-stp_10.42.42.5(pid=5010) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5010)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5031): Process ended prematurely: osmo-stp_10.42.42.5(pid=5031) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5031)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5041): Process ended prematurely: osmo-stp_10.42.42.5(pid=5041) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5041)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5052): Process ended prematurely: osmo-stp_10.42.42.5(pid=5052) [trial-2356↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5052)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=5069): Process ended prematurely: osmo-stp_10.42.42.5(pid=5069) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5069)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5081): Process ended prematurely: osmo-stp_10.42.42.5(pid=5081) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5081)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=5099): Process ended prematurely: osmo-stp_10.42.42.5(pid=5099) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5099)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5109): Process ended prematurely: osmo-stp_10.42.42.5(pid=5109) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5109)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5119): Process ended prematurely: osmo-stp_10.42.42.5(pid=5119) [trial-2356↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5119)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=5136): Process ended prematurely: osmo-stp_10.42.42.5(pid=5136) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5136)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5148): Process ended prematurely: osmo-stp_10.42.42.5(pid=5148) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5148)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=5166): Process ended prematurely: osmo-stp_10.42.42.5(pid=5166) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5166)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5177): Process ended prematurely: osmo-stp_10.42.42.5(pid=5177) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5177)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5190): Process ended prematurely: osmo-stp_10.42.42.5(pid=5190) [trial-2356↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5190)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5204): Process ended prematurely: osmo-stp_10.42.42.5(pid=5204) [trial-2356↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5204)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5217): Process ended prematurely: osmo-stp_10.42.42.5(pid=5217) [trial-2356↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5217)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=5226): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5226) [trial-2356↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5226)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5238): Process ended prematurely: osmo-stp_10.42.42.5(pid=5238) [trial-2356↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5238)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5249) [trial-2356↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5249)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5259): Process ended prematurely: osmo-stp_10.42.42.5(pid=5259) [trial-2356↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5259)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5273): Process ended prematurely: osmo-stp_10.42.42.5(pid=5273) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5273)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5284): Process ended prematurely: osmo-stp_10.42.42.5(pid=5284) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5284)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5298): Process ended prematurely: osmo-stp_10.42.42.5(pid=5298) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5298)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5309): Process ended prematurely: osmo-stp_10.42.42.5(pid=5309) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5309)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5323): Process ended prematurely: osmo-stp_10.42.42.5(pid=5323) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5334): Process ended prematurely: osmo-stp_10.42.42.5(pid=5334) [trial-2356↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5334)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5359): Process ended prematurely: osmo-stp_10.42.42.5(pid=5359) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5359)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5373): Process ended prematurely: osmo-stp_10.42.42.5(pid=5373) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5373)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5384): Process ended prematurely: osmo-stp_10.42.42.5(pid=5384) [trial-2356↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5384)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5398): Process ended prematurely: osmo-stp_10.42.42.5(pid=5398) [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5680): Process ended prematurely: osmo-stp_10.42.42.5(pid=5680) [trial-2356↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5680)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5694): Process ended prematurely: osmo-stp_10.42.42.5(pid=5694) [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5694)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5707): Process ended prematurely: osmo-stp_10.42.42.5(pid=5707) [trial-2356↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5707)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5721): Process ended prematurely: osmo-stp_10.42.42.5(pid=5721) [trial-2356↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5721)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5732): Process ended prematurely: osmo-stp_10.42.42.5(pid=5732) [trial-2356↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5732)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5750): Process ended prematurely: osmo-stp_10.42.42.5(pid=5750) [trial-2356↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5750)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5762): Process ended prematurely: osmo-stp_10.42.42.5(pid=5762) [trial-2356↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5762)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5780): Process ended prematurely: osmo-stp_10.42.42.5(pid=5780) [trial-2356↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5780)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5791): Process ended prematurely: osmo-stp_10.42.42.5(pid=5791) [trial-2356↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5791)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5804): Process ended prematurely: osmo-stp_10.42.42.5(pid=5804) [trial-2356↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5804)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5822): Process ended prematurely: osmo-stp_10.42.42.5(pid=5822) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5822)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5834): Process ended prematurely: osmo-stp_10.42.42.5(pid=5834) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5834)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5852): Process ended prematurely: osmo-stp_10.42.42.5(pid=5852) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5862): Process ended prematurely: osmo-stp_10.42.42.5(pid=5862) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5862)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5872): Process ended prematurely: osmo-stp_10.42.42.5(pid=5872) [trial-2356↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5872)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5890): Process ended prematurely: osmo-stp_10.42.42.5(pid=5890) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5890)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5902): Process ended prematurely: osmo-stp_10.42.42.5(pid=5902) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5902)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5920): Process ended prematurely: osmo-stp_10.42.42.5(pid=5920) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5920)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5930): Process ended prematurely: osmo-stp_10.42.42.5(pid=5930) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5930)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5940): Process ended prematurely: osmo-stp_10.42.42.5(pid=5940) [trial-2356↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5940)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5957): Process ended prematurely: osmo-stp_10.42.42.5(pid=5957) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5957)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5969): Process ended prematurely: osmo-stp_10.42.42.5(pid=5969) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5969)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=5989): Process ended prematurely: osmo-stp_10.42.42.5(pid=5989) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5989)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5999): Process ended prematurely: osmo-stp_10.42.42.5(pid=5999) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5999)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6009): Process ended prematurely: osmo-stp_10.42.42.5(pid=6009) [trial-2356↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6009)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6022): Process ended prematurely: osmo-stp_10.42.42.5(pid=6022) [trial-2356↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6022)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6035): Process ended prematurely: osmo-stp_10.42.42.5(pid=6035) [trial-2356↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=6043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6043) [trial-2356↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6043)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6055): Process ended prematurely: osmo-stp_10.42.42.5(pid=6055) [trial-2356↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6055)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6064): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6064) [trial-2356↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6064)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6074): Process ended prematurely: osmo-stp_10.42.42.5(pid=6074) [trial-2356↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6074)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6088): Process ended prematurely: osmo-stp_10.42.42.5(pid=6088) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6088)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6100): Process ended prematurely: osmo-stp_10.42.42.5(pid=6100) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6100)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6114): Process ended prematurely: osmo-stp_10.42.42.5(pid=6114) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6114)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6125): Process ended prematurely: osmo-stp_10.42.42.5(pid=6125) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6125)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6142): Process ended prematurely: osmo-stp_10.42.42.5(pid=6142) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6142)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6156): Process ended prematurely: osmo-stp_10.42.42.5(pid=6156) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6156)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6171): Process ended prematurely: osmo-stp_10.42.42.5(pid=6171) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6171)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6183): Process ended prematurely: osmo-stp_10.42.42.5(pid=6183) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6183)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6197): Process ended prematurely: osmo-stp_10.42.42.5(pid=6197) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6197)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6208): Process ended prematurely: osmo-stp_10.42.42.5(pid=6208) [trial-2356↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6208)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6222): Process ended prematurely: osmo-stp_10.42.42.5(pid=6222) [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6222)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6233): Process ended prematurely: osmo-stp_10.42.42.5(pid=6233) [trial-2356↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6233)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6247): Process ended prematurely: osmo-stp_10.42.42.5(pid=6247) [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6247)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6258): Process ended prematurely: osmo-stp_10.42.42.5(pid=6258) [trial-2356↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6258)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6272): Process ended prematurely: osmo-stp_10.42.42.5(pid=6272) [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6272)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6283): Process ended prematurely: osmo-stp_10.42.42.5(pid=6283) [trial-2356↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6283)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6301): Process ended prematurely: osmo-stp_10.42.42.5(pid=6301) [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6301)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6312): Process ended prematurely: osmo-stp_10.42.42.5(pid=6312) [trial-2356↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6312)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6326): Process ended prematurely: osmo-stp_10.42.42.5(pid=6326) [trial-2356↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6326)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6337): Process ended prematurely: osmo-stp_10.42.42.5(pid=6337) [trial-2356↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6337)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=6355): Process ended prematurely: osmo-stp_10.42.42.5(pid=6355) [trial-2356↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6355)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6367): Process ended prematurely: osmo-stp_10.42.42.5(pid=6367) [trial-2356↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6367)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=6385): Process ended prematurely: osmo-stp_10.42.42.5(pid=6385) [trial-2356↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6385)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6395): Process ended prematurely: osmo-stp_10.42.42.5(pid=6395) [trial-2356↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6395)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6405): Process ended prematurely: osmo-stp_10.42.42.5(pid=6405) [trial-2356↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6405)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=6422): Process ended prematurely: osmo-stp_10.42.42.5(pid=6422) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6422)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6434): Process ended prematurely: osmo-stp_10.42.42.5(pid=6434) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6434)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=6452): Process ended prematurely: osmo-stp_10.42.42.5(pid=6452) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6452)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6462): Process ended prematurely: osmo-stp_10.42.42.5(pid=6462) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6462)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6472): Process ended prematurely: osmo-stp_10.42.42.5(pid=6472) [trial-2356↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6472)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6489): Process ended prematurely: osmo-stp_10.42.42.5(pid=6489) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6489)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6505): Process ended prematurely: osmo-stp_10.42.42.5(pid=6505) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6505)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6523): Process ended prematurely: osmo-stp_10.42.42.5(pid=6523) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6534): Process ended prematurely: osmo-stp_10.42.42.5(pid=6534) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6534)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6544): Process ended prematurely: osmo-stp_10.42.42.5(pid=6544) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6544)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6562): Process ended prematurely: osmo-stp_10.42.42.5(pid=6562) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=6574): Process ended prematurely: osmo-stp_10.42.42.5(pid=6574) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6574)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=6592): Process ended prematurely: osmo-stp_10.42.42.5(pid=6592) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6592)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6602): Process ended prematurely: osmo-stp_10.42.42.5(pid=6602) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6602)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6612): Process ended prematurely: osmo-stp_10.42.42.5(pid=6612) [trial-2356↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6612)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6629): Process ended prematurely: osmo-stp_10.42.42.5(pid=6629) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6641): Process ended prematurely: osmo-stp_10.42.42.5(pid=6641) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6659): Process ended prematurely: osmo-stp_10.42.42.5(pid=6659) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6659)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6675): Process ended prematurely: osmo-stp_10.42.42.5(pid=6675) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6675)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6685): Process ended prematurely: osmo-stp_10.42.42.5(pid=6685) [trial-2356↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6685)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6699): Process ended prematurely: osmo-stp_10.42.42.5(pid=6699) [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6699)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6981): Process ended prematurely: osmo-stp_10.42.42.5(pid=6981) [trial-2356↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6981)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=6991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6991) [trial-2356↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6991)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7001): Process ended prematurely: osmo-stp_10.42.42.5(pid=7001) [trial-2356↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7001)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7010): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7010) [trial-2356↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7010)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7020): Process ended prematurely: osmo-stp_10.42.42.5(pid=7020) [trial-2356↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7020)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7034): Process ended prematurely: osmo-stp_10.42.42.5(pid=7034) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7034)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7045): Process ended prematurely: osmo-stp_10.42.42.5(pid=7045) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7045)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7059): Process ended prematurely: osmo-stp_10.42.42.5(pid=7059) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7059)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7070): Process ended prematurely: osmo-stp_10.42.42.5(pid=7070) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7070)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7084): Process ended prematurely: osmo-stp_10.42.42.5(pid=7084) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7084)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7095): Process ended prematurely: osmo-stp_10.42.42.5(pid=7095) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7095)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7109): Process ended prematurely: osmo-stp_10.42.42.5(pid=7109) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7123): Process ended prematurely: osmo-stp_10.42.42.5(pid=7123) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7137): Process ended prematurely: osmo-stp_10.42.42.5(pid=7137) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7137)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7148): Process ended prematurely: osmo-stp_10.42.42.5(pid=7148) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7162): Process ended prematurely: osmo-stp_10.42.42.5(pid=7162) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7173): Process ended prematurely: osmo-stp_10.42.42.5(pid=7173) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7173)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7187): Process ended prematurely: osmo-stp_10.42.42.5(pid=7187) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7187)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7198): Process ended prematurely: osmo-stp_10.42.42.5(pid=7198) [trial-2356↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7198)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7212): Process ended prematurely: osmo-stp_10.42.42.5(pid=7212) [trial-2356↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7212)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7223): Process ended prematurely: osmo-stp_10.42.42.5(pid=7223) [trial-2356↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7223)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=7241): Process ended prematurely: osmo-stp_10.42.42.5(pid=7241) [trial-2356↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7241)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7253): Process ended prematurely: osmo-stp_10.42.42.5(pid=7253) [trial-2356↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7253)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=7271): Process ended prematurely: osmo-stp_10.42.42.5(pid=7271) [trial-2356↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7271)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7281): Process ended prematurely: osmo-stp_10.42.42.5(pid=7281) [trial-2356↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7281)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7292): Process ended prematurely: osmo-stp_10.42.42.5(pid=7292) [trial-2356↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7292)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7309): Process ended prematurely: osmo-stp_10.42.42.5(pid=7309) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7309)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7321): Process ended prematurely: osmo-stp_10.42.42.5(pid=7321) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7321)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=7339): Process ended prematurely: osmo-stp_10.42.42.5(pid=7339) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7339)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7350): Process ended prematurely: osmo-stp_10.42.42.5(pid=7350) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7360): Process ended prematurely: osmo-stp_10.42.42.5(pid=7360) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7360)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=7377): Process ended prematurely: osmo-stp_10.42.42.5(pid=7377) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7377)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7393): Process ended prematurely: osmo-stp_10.42.42.5(pid=7393) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7393)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=7411): Process ended prematurely: osmo-stp_10.42.42.5(pid=7411) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7411)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7421): Process ended prematurely: osmo-stp_10.42.42.5(pid=7421) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7421)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7431): Process ended prematurely: osmo-stp_10.42.42.5(pid=7431) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7431)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7448): Process ended prematurely: osmo-stp_10.42.42.5(pid=7448) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7460): Process ended prematurely: osmo-stp_10.42.42.5(pid=7460) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7460)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=7481): Process ended prematurely: osmo-stp_10.42.42.5(pid=7481) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7481)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7491): Process ended prematurely: osmo-stp_10.42.42.5(pid=7491) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7491)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7501): Process ended prematurely: osmo-stp_10.42.42.5(pid=7501) [trial-2356↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7501)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7514): Process ended prematurely: osmo-stp_10.42.42.5(pid=7514) [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7514)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7528): Process ended prematurely: osmo-stp_10.42.42.5(pid=7528) [trial-2356↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7528)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=7536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7536) [trial-2356↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7536)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7547): Process ended prematurely: osmo-stp_10.42.42.5(pid=7547) [trial-2356↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7547)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=7556): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7556) [trial-2356↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7556)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7566): Process ended prematurely: osmo-stp_10.42.42.5(pid=7566) [trial-2356↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7566)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7580): Process ended prematurely: osmo-stp_10.42.42.5(pid=7580) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7580)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7591): Process ended prematurely: osmo-stp_10.42.42.5(pid=7591) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7591)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7605): Process ended prematurely: osmo-stp_10.42.42.5(pid=7605) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7605)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7616): Process ended prematurely: osmo-stp_10.42.42.5(pid=7616) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7616)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7637): Process ended prematurely: osmo-stp_10.42.42.5(pid=7637) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7648): Process ended prematurely: osmo-stp_10.42.42.5(pid=7648) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7648)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7662): Process ended prematurely: osmo-stp_10.42.42.5(pid=7662) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7662)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7673): Process ended prematurely: osmo-stp_10.42.42.5(pid=7673) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7673)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7688): Process ended prematurely: osmo-stp_10.42.42.5(pid=7688) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7688)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7699): Process ended prematurely: osmo-stp_10.42.42.5(pid=7699) [trial-2356↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7699)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7714): Process ended prematurely: osmo-stp_10.42.42.5(pid=7714) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7714)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7725): Process ended prematurely: osmo-stp_10.42.42.5(pid=7725) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7740): Process ended prematurely: osmo-stp_10.42.42.5(pid=7740) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7740)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7751): Process ended prematurely: osmo-stp_10.42.42.5(pid=7751) [trial-2356↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7751)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7765): Process ended prematurely: osmo-stp_10.42.42.5(pid=7765) [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7776): Process ended prematurely: osmo-stp_10.42.42.5(pid=7776) [trial-2356↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7776)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7790): Process ended prematurely: osmo-stp_10.42.42.5(pid=7790) [trial-2356↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7790)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7801): Process ended prematurely: osmo-stp_10.42.42.5(pid=7801) [trial-2356↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=7822): Process ended prematurely: osmo-stp_10.42.42.5(pid=7822) [trial-2356↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7822)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7834): Process ended prematurely: osmo-stp_10.42.42.5(pid=7834) [trial-2356↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7834)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=7852): Process ended prematurely: osmo-stp_10.42.42.5(pid=7852) [trial-2356↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7852)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7862): Process ended prematurely: osmo-stp_10.42.42.5(pid=7862) [trial-2356↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7862)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7872): Process ended prematurely: osmo-stp_10.42.42.5(pid=7872) [trial-2356↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7872)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=7889): Process ended prematurely: osmo-stp_10.42.42.5(pid=7889) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7889)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7901): Process ended prematurely: osmo-stp_10.42.42.5(pid=7901) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7901)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=7919): Process ended prematurely: osmo-stp_10.42.42.5(pid=7919) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7919)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7929): Process ended prematurely: osmo-stp_10.42.42.5(pid=7929) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7929)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7939): Process ended prematurely: osmo-stp_10.42.42.5(pid=7939) [trial-2356↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7939)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7956): Process ended prematurely: osmo-stp_10.42.42.5(pid=7956) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7968): Process ended prematurely: osmo-stp_10.42.42.5(pid=7968) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7968)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=7986): Process ended prematurely: osmo-stp_10.42.42.5(pid=7986) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7986)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7997): Process ended prematurely: osmo-stp_10.42.42.5(pid=7997) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7997)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8007): Process ended prematurely: osmo-stp_10.42.42.5(pid=8007) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8007)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=8024): Process ended prematurely: osmo-stp_10.42.42.5(pid=8024) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8024)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=8307): Process ended prematurely: osmo-stp_10.42.42.5(pid=8307) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8307)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=8326): Process ended prematurely: osmo-stp_10.42.42.5(pid=8326) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8326)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8336): Process ended prematurely: osmo-stp_10.42.42.5(pid=8336) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8346): Process ended prematurely: osmo-stp_10.42.42.5(pid=8346) [trial-2356↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8346)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8364): Process ended prematurely: osmo-stp_10.42.42.5(pid=8364) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8364)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8376): Process ended prematurely: osmo-stp_10.42.42.5(pid=8376) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8376)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=8394): Process ended prematurely: osmo-stp_10.42.42.5(pid=8394) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8394)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8405): Process ended prematurely: osmo-stp_10.42.42.5(pid=8405) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8405)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8415): Process ended prematurely: osmo-stp_10.42.42.5(pid=8415) [trial-2356↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8415)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8430): Process ended prematurely: osmo-stp_10.42.42.5(pid=8430) [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8430)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8446): Process ended prematurely: osmo-stp_10.42.42.5(pid=8446) [trial-2356↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8446)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=8454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8454) [trial-2356↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8454)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=8464): Process ended prematurely: osmo-stp_10.42.42.5(pid=8464) [trial-2356↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8464)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=8473): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8473) [trial-2356↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8473)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8483): Process ended prematurely: osmo-stp_10.42.42.5(pid=8483) [trial-2356↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8483)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8497): Process ended prematurely: osmo-stp_10.42.42.5(pid=8497) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8497)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8508): Process ended prematurely: osmo-stp_10.42.42.5(pid=8508) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8508)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8522): Process ended prematurely: osmo-stp_10.42.42.5(pid=8522) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8522)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8533): Process ended prematurely: osmo-stp_10.42.42.5(pid=8533) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8533)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8547): Process ended prematurely: osmo-stp_10.42.42.5(pid=8547) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8547)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8558): Process ended prematurely: osmo-stp_10.42.42.5(pid=8558) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8558)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8573): Process ended prematurely: osmo-stp_10.42.42.5(pid=8573) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8573)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8591): Process ended prematurely: osmo-stp_10.42.42.5(pid=8591) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8591)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8605): Process ended prematurely: osmo-stp_10.42.42.5(pid=8605) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8605)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8616): Process ended prematurely: osmo-stp_10.42.42.5(pid=8616) [trial-2356↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8616)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8630): Process ended prematurely: osmo-stp_10.42.42.5(pid=8630) [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8641): Process ended prematurely: osmo-stp_10.42.42.5(pid=8641) [trial-2356↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8655): Process ended prematurely: osmo-stp_10.42.42.5(pid=8655) [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8666): Process ended prematurely: osmo-stp_10.42.42.5(pid=8666) [trial-2356↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2356↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8691): Process ended prematurely: osmo-stp_10.42.42.5(pid=8691) [trial-2356↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8710): Process ended prematurely: osmo-stp_10.42.42.5(pid=8710) [trial-2356↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8722): Process ended prematurely: osmo-stp_10.42.42.5(pid=8722) [trial-2356↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8722)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8740): Process ended prematurely: osmo-stp_10.42.42.5(pid=8740) [trial-2356↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8740)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8751): Process ended prematurely: osmo-stp_10.42.42.5(pid=8751) [trial-2356↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8751)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8761): Process ended prematurely: osmo-stp_10.42.42.5(pid=8761) [trial-2356↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8761)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=8778): Process ended prematurely: osmo-stp_10.42.42.5(pid=8778) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8778)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8793): Process ended prematurely: osmo-stp_10.42.42.5(pid=8793) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8793)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=8811): Process ended prematurely: osmo-stp_10.42.42.5(pid=8811) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8811)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8821): Process ended prematurely: osmo-stp_10.42.42.5(pid=8821) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8821)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8831): Process ended prematurely: osmo-stp_10.42.42.5(pid=8831) [trial-2356↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8831)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8848): Process ended prematurely: osmo-stp_10.42.42.5(pid=8848) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8848)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8860): Process ended prematurely: osmo-stp_10.42.42.5(pid=8860) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8860)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8879): Process ended prematurely: osmo-stp_10.42.42.5(pid=8879) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8889): Process ended prematurely: osmo-stp_10.42.42.5(pid=8889) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8889)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8899): Process ended prematurely: osmo-stp_10.42.42.5(pid=8899) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8899)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=8917): Process ended prematurely: osmo-stp_10.42.42.5(pid=8917) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8917)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8930): Process ended prematurely: osmo-stp_10.42.42.5(pid=8930) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8930)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8948): Process ended prematurely: osmo-stp_10.42.42.5(pid=8948) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8948)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8958): Process ended prematurely: osmo-stp_10.42.42.5(pid=8958) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8958)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8969): Process ended prematurely: osmo-stp_10.42.42.5(pid=8969) [trial-2356↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8969)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8982): Process ended prematurely: osmo-stp_10.42.42.5(pid=8982) [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8982)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8995): Process ended prematurely: osmo-stp_10.42.42.5(pid=8995) [trial-2356↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8995)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9003): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9003) [trial-2356↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9003)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9014): Process ended prematurely: osmo-stp_10.42.42.5(pid=9014) [trial-2356↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9014)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=9023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9023) [trial-2356↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9023)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9033): Process ended prematurely: osmo-stp_10.42.42.5(pid=9033) [trial-2356↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9033)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9047): Process ended prematurely: osmo-stp_10.42.42.5(pid=9047) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9047)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9059): Process ended prematurely: osmo-stp_10.42.42.5(pid=9059) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9073): Process ended prematurely: osmo-stp_10.42.42.5(pid=9073) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9073)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9084): Process ended prematurely: osmo-stp_10.42.42.5(pid=9084) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9084)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9098): Process ended prematurely: osmo-stp_10.42.42.5(pid=9098) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9098)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9109): Process ended prematurely: osmo-stp_10.42.42.5(pid=9109) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9123): Process ended prematurely: osmo-stp_10.42.42.5(pid=9123) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9123)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9134): Process ended prematurely: osmo-stp_10.42.42.5(pid=9134) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9134)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9158): Process ended prematurely: osmo-stp_10.42.42.5(pid=9158) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9158)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9520): Process ended prematurely: osmo-stp_10.42.42.5(pid=9520) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9736): Process ended prematurely: osmo-stp_10.42.42.5(pid=9736) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9747): Process ended prematurely: osmo-stp_10.42.42.5(pid=9747) [trial-2356↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9747)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9761): Process ended prematurely: osmo-stp_10.42.42.5(pid=9761) [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9772): Process ended prematurely: osmo-stp_10.42.42.5(pid=9772) [trial-2356↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9772)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9791): Process ended prematurely: osmo-stp_10.42.42.5(pid=9791) [trial-2356↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9803): Process ended prematurely: osmo-stp_10.42.42.5(pid=9803) [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9803)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9821): Process ended prematurely: osmo-stp_10.42.42.5(pid=9821) [trial-2356↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9821)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9831): Process ended prematurely: osmo-stp_10.42.42.5(pid=9831) [trial-2356↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9831)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9841): Process ended prematurely: osmo-stp_10.42.42.5(pid=9841) [trial-2356↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9841)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=9860): Process ended prematurely: osmo-stp_10.42.42.5(pid=9860) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9860)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9872): Process ended prematurely: osmo-stp_10.42.42.5(pid=9872) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9872)] FAIL: iperf3m4.py (12.2 sec) Error: osmo-stp_10.42.42.5(pid=10161): Process ended prematurely: osmo-stp_10.42.42.5(pid=10161) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10171): Process ended prematurely: osmo-stp_10.42.42.5(pid=10171) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10171)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10181): Process ended prematurely: osmo-stp_10.42.42.5(pid=10181) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10198): Process ended prematurely: osmo-stp_10.42.42.5(pid=10198) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10198)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10210): Process ended prematurely: osmo-stp_10.42.42.5(pid=10210) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10210)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10228): Process ended prematurely: osmo-stp_10.42.42.5(pid=10228) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10228)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10238): Process ended prematurely: osmo-stp_10.42.42.5(pid=10238) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10238)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10248): Process ended prematurely: osmo-stp_10.42.42.5(pid=10248) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10248)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10265): Process ended prematurely: osmo-stp_10.42.42.5(pid=10265) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10265)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10277): Process ended prematurely: osmo-stp_10.42.42.5(pid=10277) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10277)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=10298): Process ended prematurely: osmo-stp_10.42.42.5(pid=10298) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10298)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10308): Process ended prematurely: osmo-stp_10.42.42.5(pid=10308) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10308)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10318): Process ended prematurely: osmo-stp_10.42.42.5(pid=10318) [trial-2356↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10318)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10334): Process ended prematurely: osmo-stp_10.42.42.5(pid=10334) [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10334)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10347): Process ended prematurely: osmo-stp_10.42.42.5(pid=10347) [trial-2356↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10347)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=10355): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10355) [trial-2356↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10355)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2356↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=10374): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10374) [trial-2356↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10374)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10384): Process ended prematurely: osmo-stp_10.42.42.5(pid=10384) [trial-2356↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10384)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10398): Process ended prematurely: osmo-stp_10.42.42.5(pid=10398) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10398)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10409): Process ended prematurely: osmo-stp_10.42.42.5(pid=10409) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10409)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10435): Process ended prematurely: osmo-stp_10.42.42.5(pid=10435) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10435)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10449): Process ended prematurely: osmo-stp_10.42.42.5(pid=10449) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10449)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10460): Process ended prematurely: osmo-stp_10.42.42.5(pid=10460) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10460)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10475): Process ended prematurely: osmo-stp_10.42.42.5(pid=10475) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10475)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10486): Process ended prematurely: osmo-stp_10.42.42.5(pid=10486) [trial-2356↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10486)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10500): Process ended prematurely: osmo-stp_10.42.42.5(pid=10500) [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10500)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10511): Process ended prematurely: osmo-stp_10.42.42.5(pid=10511) [trial-2356↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10511)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10538): Process ended prematurely: osmo-stp_10.42.42.5(pid=10538) [trial-2356↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10549): Process ended prematurely: osmo-stp_10.42.42.5(pid=10549) [trial-2356↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=10567): Process ended prematurely: osmo-stp_10.42.42.5(pid=10567) [trial-2356↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10567)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10579): Process ended prematurely: osmo-stp_10.42.42.5(pid=10579) [trial-2356↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10579)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10597): Process ended prematurely: osmo-stp_10.42.42.5(pid=10597) [trial-2356↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10597)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10607): Process ended prematurely: osmo-stp_10.42.42.5(pid=10607) [trial-2356↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10607)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10617): Process ended prematurely: osmo-stp_10.42.42.5(pid=10617) [trial-2356↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10617)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10634): Process ended prematurely: osmo-stp_10.42.42.5(pid=10634) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10634)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10652): Process ended prematurely: osmo-stp_10.42.42.5(pid=10652) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10652)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10670): Process ended prematurely: osmo-stp_10.42.42.5(pid=10670) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10670)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10680): Process ended prematurely: osmo-stp_10.42.42.5(pid=10680) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10680)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10690): Process ended prematurely: osmo-stp_10.42.42.5(pid=10690) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10690)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=10707): Process ended prematurely: osmo-stp_10.42.42.5(pid=10707) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10707)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=10719): Process ended prematurely: osmo-stp_10.42.42.5(pid=10719) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10719)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=10737): Process ended prematurely: osmo-stp_10.42.42.5(pid=10737) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10737)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10748): Process ended prematurely: osmo-stp_10.42.42.5(pid=10748) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10748)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10758): Process ended prematurely: osmo-stp_10.42.42.5(pid=10758) [trial-2356↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10758)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10771): Process ended prematurely: osmo-stp_10.42.42.5(pid=10771) [trial-2356↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10785): Process ended prematurely: osmo-stp_10.42.42.5(pid=10785) [trial-2356↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10785)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10795): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10795) [trial-2356↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10795)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2356↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10819): Process ended prematurely: osmo-stp_10.42.42.5(pid=10819) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10819)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10831): Process ended prematurely: osmo-stp_10.42.42.5(pid=10831) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10831)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10845): Process ended prematurely: osmo-stp_10.42.42.5(pid=10845) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10845)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10856): Process ended prematurely: osmo-stp_10.42.42.5(pid=10856) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10856)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10871): Process ended prematurely: osmo-stp_10.42.42.5(pid=10871) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10871)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10882): Process ended prematurely: osmo-stp_10.42.42.5(pid=10882) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10896): Process ended prematurely: osmo-stp_10.42.42.5(pid=10896) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10896)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10920): Process ended prematurely: osmo-stp_10.42.42.5(pid=10920) [trial-2356↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10920)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10934): Process ended prematurely: osmo-stp_10.42.42.5(pid=10934) [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10934)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10945): Process ended prematurely: osmo-stp_10.42.42.5(pid=10945) [trial-2356↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10945)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10961): Process ended prematurely: osmo-stp_10.42.42.5(pid=10961) [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10961)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10972): Process ended prematurely: osmo-stp_10.42.42.5(pid=10972) [trial-2356↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10972)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10986): Process ended prematurely: osmo-stp_10.42.42.5(pid=10986) [trial-2356↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10999): Process ended prematurely: osmo-stp_10.42.42.5(pid=10999) [trial-2356↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10999)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11039): Process ended prematurely: osmo-stp_10.42.42.5(pid=11039) [trial-2356↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11052): Process ended prematurely: osmo-stp_10.42.42.5(pid=11052) [trial-2356↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11052)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=11070): Process ended prematurely: osmo-stp_10.42.42.5(pid=11070) [trial-2356↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11070)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11080): Process ended prematurely: osmo-stp_10.42.42.5(pid=11080) [trial-2356↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11080)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11090): Process ended prematurely: osmo-stp_10.42.42.5(pid=11090) [trial-2356↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11090)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=11107): Process ended prematurely: osmo-stp_10.42.42.5(pid=11107) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11107)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11119): Process ended prematurely: osmo-stp_10.42.42.5(pid=11119) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11137): Process ended prematurely: osmo-stp_10.42.42.5(pid=11137) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11137)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11157): Process ended prematurely: osmo-stp_10.42.42.5(pid=11157) [trial-2356↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11157)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11175): Process ended prematurely: osmo-stp_10.42.42.5(pid=11175) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11175)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11187): Process ended prematurely: osmo-stp_10.42.42.5(pid=11187) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11187)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=11205): Process ended prematurely: osmo-stp_10.42.42.5(pid=11205) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11215): Process ended prematurely: osmo-stp_10.42.42.5(pid=11215) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11215)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11225): Process ended prematurely: osmo-stp_10.42.42.5(pid=11225) [trial-2356↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11225)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=11514): Process ended prematurely: osmo-stp_10.42.42.5(pid=11514) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11514)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11526): Process ended prematurely: osmo-stp_10.42.42.5(pid=11526) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11526)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11546): Process ended prematurely: osmo-stp_10.42.42.5(pid=11546) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11546)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11557): Process ended prematurely: osmo-stp_10.42.42.5(pid=11557) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11557)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11567): Process ended prematurely: osmo-stp_10.42.42.5(pid=11567) [trial-2356↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11567)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11580): Process ended prematurely: osmo-stp_10.42.42.5(pid=11580) [trial-2356↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11580)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=11588): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11588) [trial-2356↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11588)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=11590): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11590) [trial-2356↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11590)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=11592): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11592) [trial-2356↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11592)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11594): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11594) [trial-2356↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11594)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=11604): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11604) [trial-2356↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11604)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=11615): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11615) [trial-2356↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11615)] FAIL: esme_ms_sms_storeforward.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11627): Process ended prematurely: osmo-stp_10.42.42.5(pid=11627) [trial-2356↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11627)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11638): Process ended prematurely: osmo-stp_10.42.42.5(pid=11638) [trial-2356↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11638)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11655): Process ended prematurely: osmo-stp_10.42.42.5(pid=11655) [trial-2356↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11655)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11666): Process ended prematurely: osmo-stp_10.42.42.5(pid=11666) [trial-2356↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11666)] FAIL: register_a5_1_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11677): Process ended prematurely: osmo-stp_10.42.42.5(pid=11677) [trial-2356↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11677)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11688): Process ended prematurely: osmo-stp_10.42.42.5(pid=11688) [trial-2356↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11688)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=11708): Process ended prematurely: srsepc(pid=11708) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11708)] FAIL: iperf3_bidir.py (18.7 sec) Error: srsepc(pid=11724): Process ended prematurely: srsepc(pid=11724) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11724)] FAIL: iperf3_dl.py (19.2 sec) Error: srsepc(pid=11740): Process ended prematurely: srsepc(pid=11740) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11740)] FAIL: iperf3_ul.py (18.7 sec) Error: srsepc(pid=11756): Process ended prematurely: srsepc(pid=11756) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11756)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=11773): Process ended prematurely: srsepc(pid=11773) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11773)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=11789): Process ended prematurely: srsepc(pid=11789) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11789)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=11808): Process ended prematurely: srsepc(pid=11808) [trial-2356↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11808)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11822): Process ended prematurely: osmo-stp_10.42.42.5(pid=11822) [trial-2356↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11822)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11837): Process ended prematurely: osmo-stp_10.42.42.5(pid=11837) [trial-2356↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11837)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11852): Process ended prematurely: osmo-stp_10.42.42.5(pid=11852) [trial-2356↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11866): Process ended prematurely: osmo-stp_10.42.42.5(pid=11866) [trial-2356↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11866)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=11880): Process ended prematurely: osmo-stp_10.42.42.5(pid=11880) [trial-2356↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11880)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11894): Process ended prematurely: osmo-stp_10.42.42.5(pid=11894) [trial-2356↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11894)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11909): Process ended prematurely: osmo-stp_10.42.42.5(pid=11909) [trial-2356↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11909)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11923): Process ended prematurely: osmo-stp_10.42.42.5(pid=11923) [trial-2356↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11923)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11937): Process ended prematurely: osmo-stp_10.42.42.5(pid=11937) [trial-2356↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11937)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11951): Process ended prematurely: osmo-stp_10.42.42.5(pid=11951) [trial-2356↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11951)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11965): Process ended prematurely: osmo-stp_10.42.42.5(pid=11965) [trial-2356↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11965)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11989): Process ended prematurely: osmo-stp_10.42.42.5(pid=11989) [trial-2356↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11989)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12354): Process ended prematurely: osmo-stp_10.42.42.5(pid=12354) [trial-2356↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12354)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12544): Process ended prematurely: osmo-stp_10.42.42.5(pid=12544) [trial-2356↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12544)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12558): Process ended prematurely: osmo-stp_10.42.42.5(pid=12558) [trial-2356↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12572): Process ended prematurely: osmo-stp_10.42.42.5(pid=12572) [trial-2356↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12572)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12587): Process ended prematurely: osmo-stp_10.42.42.5(pid=12587) [trial-2356↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12587)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12601): Process ended prematurely: osmo-stp_10.42.42.5(pid=12601) [trial-2356↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12601)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12615): Process ended prematurely: osmo-stp_10.42.42.5(pid=12615) [trial-2356↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12615)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12629): Process ended prematurely: osmo-stp_10.42.42.5(pid=12629) [trial-2356↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12643): Process ended prematurely: osmo-stp_10.42.42.5(pid=12643) [trial-2356↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12643)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12660): Process ended prematurely: osmo-stp_10.42.42.5(pid=12660) [trial-2356↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12660)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=12674): Process ended prematurely: osmo-stp_10.42.42.5(pid=12674) [trial-2356↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12674)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12688): Process ended prematurely: osmo-stp_10.42.42.5(pid=12688) [trial-2356↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12706): Process ended prematurely: osmo-stp_10.42.42.5(pid=12706) [trial-2356↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12706)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12720): Process ended prematurely: osmo-stp_10.42.42.5(pid=12720) [trial-2356↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12720)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12734): Process ended prematurely: osmo-stp_10.42.42.5(pid=12734) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12734)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12748): Process ended prematurely: osmo-stp_10.42.42.5(pid=12748) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12748)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12762): Process ended prematurely: osmo-stp_10.42.42.5(pid=12762) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12762)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12776): Process ended prematurely: osmo-stp_10.42.42.5(pid=12776) [trial-2356↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12776)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12790): Process ended prematurely: osmo-stp_10.42.42.5(pid=12790) [trial-2356↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12790)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12804): Process ended prematurely: osmo-stp_10.42.42.5(pid=12804) [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12804)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12819): Process ended prematurely: osmo-stp_10.42.42.5(pid=12819) [trial-2356↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12819)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12833): Process ended prematurely: osmo-stp_10.42.42.5(pid=12833) [trial-2356↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12833)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12847): Process ended prematurely: osmo-stp_10.42.42.5(pid=12847) [trial-2356↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12847)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12863): Process ended prematurely: osmo-stp_10.42.42.5(pid=12863) [trial-2356↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12863)] + rm -rf trial-2356/inst + cd trial-2356 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 06:55:01 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356-run.tgz run.2022-12-09_06-55-12 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2356-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2944.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29256.tgz osmo-nitb.build-12964.tgz osmo-pcu-oc2g.build-3906.tgz osmo-pcu-sysmo.build-5188.tgz osmo-pcu.build-5149.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE